-- Logs begin at Mon 2022-06-20 11:32:11 UTC, end at Mon 2022-06-20 12:41:32 UTC. -- Jun 20 12:14:10.420454 dv-cinder-836973-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 12:14:10.427742 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 12:14:10 2022] *** Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: nodename: dv-cinder-836973-4-iscsi Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: machine: x86_64 Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: clock source: unix Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: pcre jit disabled Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: detected number of CPU cores: 4 Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: current working directory: / Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: detected binary path: /usr/bin/uwsgi-core Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: your processes number limit is 47680 Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: your memory page size is 4096 bytes Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: detected max file descriptor number: 2048 Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: lock engine: pthread robust mutexes Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: thunder lock: enabled Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 12:14:10.432680 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 12:14:10.476675 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: Python main interpreter initialized at 0x55893989f9c0 Jun 20 12:14:10.476675 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: python threads support enabled Jun 20 12:14:10.476675 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: your server socket listen backlog is limited to 100 connections Jun 20 12:14:10.476675 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: your mercy for graceful operations on workers is 90 seconds Jun 20 12:14:10.477033 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 12:14:10.477108 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: *** Operational MODE: preforking *** Jun 20 12:14:10.477331 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: *** uWSGI is running in multiple interpreter mode *** Jun 20 12:14:10.477331 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: spawned uWSGI master process (pid: 103691) Jun 20 12:14:10.477547 dv-cinder-836973-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 12:14:10.478272 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: spawned uWSGI worker 1 (pid: 103692, cores: 1) Jun 20 12:14:10.480372 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: spawned uWSGI worker 2 (pid: 103693, cores: 1) Jun 20 12:14:10.480372 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 12:14:11.144707 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 12:14:11.145304 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 12:14:12.284088 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:14:12.284088 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: from cryptography.utils import int_from_bytes Jun 20 12:14:12.284681 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:14:12.284681 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: from cryptography.utils import int_from_bytes Jun 20 12:14:12.285954 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:14:12.285954 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: from cryptography.utils import int_from_bytes Jun 20 12:14:12.286383 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:14:12.286383 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: from cryptography.utils import int_from_bytes Jun 20 12:14:14.813992 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:14:14.814553 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:14:14.814757 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:14:14.815118 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:14:14.815377 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:14:14.815515 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:14:14.815872 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.815963 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:14:14.816080 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.816285 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:14:14.816404 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.816654 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:14:14.816749 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.816915 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:14:14.817040 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.817321 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.817420 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.817653 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.817741 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.817996 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.818103 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.818321 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.818416 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.818600 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.819258 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.819446 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.819752 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.819895 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-4-iscsi {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.820075 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.820209 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.820380 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.820519 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.820690 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.820819 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.820999 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.821134 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.821300 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.821436 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.821622 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.821757 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-4-iscsi {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.821963 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.822122 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.822290 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.822464 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.822636 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.822902 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.823058 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.823208 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.823346 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.823501 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.823647 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.823811 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.823956 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.824131 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.824314 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.824470 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.824627 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.824755 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.824936 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.825056 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.825247 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.825377 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.825587 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.825715 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.825929 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.826071 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-4-iscsi {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.826239 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.826374 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.826559 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.826689 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.826895 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.827011 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.827204 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.827371 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.827520 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.827686 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.827922 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-4-iscsi {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.828052 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.828243 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.828391 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.828559 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.828695 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.828875 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.829031 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.829235 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.829374 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.829523 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.829651 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.829863 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.830011 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.830187 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.830316 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.830489 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.830620 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.830801 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.830939 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.831115 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.831245 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.831437 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.831565 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.831743 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.831874 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.832048 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.832175 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.832298 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.832421 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.832599 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.832728 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.832925 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.833080 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.833246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.833376 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.833569 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.833704 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.833872 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.834003 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.834127 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.834291 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.834455 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.834783 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.834915 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.835104 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.835242 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.835403 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.835533 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.835715 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.835844 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.836028 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.836172 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.836300 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.836431 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.836594 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.836723 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.836976 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.837117 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.837235 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.837366 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.837524 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.837655 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.837861 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.838009 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.838178 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.838315 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.838512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.838641 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.838840 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.838971 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.839151 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.839287 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.839465 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.839595 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.839774 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.839904 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.840094 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.840221 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.840421 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.840547 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.840729 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.840859 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.841048 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.841177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.841369 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.841507 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.841677 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.841859 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.842010 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.842151 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.842323 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.842460 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.842646 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.842867 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843014 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843153 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843289 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843429 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843555 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843680 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843804 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.843952 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.844081 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.844262 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.844393 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.844574 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.844702 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.844899 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.845035 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.845263 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.845394 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.845571 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.845698 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.845856 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.845982 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.846124 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.846251 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.846434 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.846573 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.846757 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.846900 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.847068 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.847204 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.847373 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.847501 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.847681 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.847817 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.847983 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.848118 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.848288 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.848424 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.848596 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.848733 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.848904 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.849032 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.849211 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.849352 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.849520 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.849659 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.849879 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.850018 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.850257 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.850388 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.850583 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.850720 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.850893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.851033 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.851201 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.851331 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.851523 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.851662 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.851831 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.851969 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.852136 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.852265 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.852461 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.852598 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.852751 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.852906 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.853107 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.853235 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.853359 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.853497 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.853654 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.853791 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.853990 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.854118 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.854310 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.854442 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.854619 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.854747 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.854926 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.855055 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.855237 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.855374 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.855542 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.855672 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.855846 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.855974 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.856150 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.856279 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.856453 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.856590 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.856754 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.856892 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.857053 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.857185 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.857372 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.857511 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.857673 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.857845 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.858003 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.858134 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.858311 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.858451 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.858615 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.858751 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.858901 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.859035 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.859207 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.859343 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.859510 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.859648 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.859828 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.859964 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.860152 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.860282 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.860466 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.860604 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.860784 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.860912 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.861092 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.861221 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.861415 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:14:14.861545 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.861749 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.861922 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.862102 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.862230 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.862416 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.862546 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.862726 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.862855 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.863038 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.863244 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.863385 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.863519 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.863665 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.863795 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.864000 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.864139 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.864315 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.864444 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.864627 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.864755 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.864947 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.865102 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.865263 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.865393 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.866111 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.866248 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.866449 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.866580 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.866827 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.866957 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.867145 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.867274 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.867468 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.867606 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.867789 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.867926 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.868123 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.868258 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.868435 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.868572 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.868757 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.868885 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.869068 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.869205 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.869379 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.869521 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.869690 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.869842 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.870039 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.870168 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.870379 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.870526 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.870698 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.870835 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.871019 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.871154 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.871333 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.871463 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.871645 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.871766 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.871954 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.872081 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.872264 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.872392 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.872576 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.872703 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.872915 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.873044 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.873301 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.873450 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.873586 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.873710 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.873870 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.873998 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.874181 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.874312 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.874491 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.874627 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.874802 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.875001 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.875140 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.875266 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.875403 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.875528 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.875706 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.875843 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.876005 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.876135 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.876314 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.876445 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.876619 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.876762 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.876939 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.877078 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.877258 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.877386 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.877565 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.877705 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.877915 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.878046 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.878222 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.878349 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.878529 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.878670 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.878836 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.878971 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.879141 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.879276 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.879450 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.879579 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.879766 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.879901 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.880082 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.880211 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.880390 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.880529 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.880717 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.880846 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.881028 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.881190 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.881969 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.882102 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.882288 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.882425 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.882603 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.882739 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.882926 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.883065 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.883243 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.883387 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.883579 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.883717 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.883873 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.884002 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.884189 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.884320 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.884522 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.884660 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.884852 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.884982 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.885166 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.885308 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.885476 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.885619 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.885815 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.885960 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.886149 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.886282 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.886468 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.886605 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.886786 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.886924 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.887103 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.887232 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.887424 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.887554 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.887732 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.887860 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.888042 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.888171 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.888351 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.888489 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.888659 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.888897 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889033 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889166 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889301 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889434 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889561 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889685 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889844 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.889973 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.890151 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.890269 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.890457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.890581 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.890764 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.890903 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.891088 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.891218 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.891396 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.891534 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.891703 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.891841 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.892009 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.892138 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.892314 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.892451 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.892646 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.892784 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.892950 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.893078 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.893254 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.893382 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.893625 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.893773 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.893959 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.894085 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.894209 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.894333 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.894500 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.894631 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.894809 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.894938 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.895157 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.895294 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.895477 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.895605 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.895793 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.895930 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.896108 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.896236 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.896433 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.896563 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.896785 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.896926 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.897114 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.897251 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.897428 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.897562 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.897740 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.897902 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.898083 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.898223 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.898397 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.898526 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.898703 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.898839 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.899019 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.899158 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.899332 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.899460 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.899656 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.899841 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.899984 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.900124 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.900295 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.900424 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.900606 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.900725 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.900924 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.901060 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.901232 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.901358 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.901542 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.901669 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.901888 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.902019 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.902205 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.902335 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.902530 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.902657 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.902844 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.902981 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.903432 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.903569 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.903750 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.903882 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.904062 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.904164 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.904377 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.904476 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.904692 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.904789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.905002 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.905136 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.905320 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.905446 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.905632 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.905766 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.905964 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.906075 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.906285 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.906424 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.906613 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.906751 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.906930 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.907059 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.907256 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.907393 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.907589 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.907726 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.907902 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.908032 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.908211 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.908339 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.908521 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.908663 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.908832 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.908961 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.909149 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.909291 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.909461 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.909601 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.909772 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.909919 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.910105 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.910234 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.910421 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.910553 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.910732 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.910860 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.911035 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.911164 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.911340 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.911470 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.911656 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.911784 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.911971 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.912106 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.912283 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.912481 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.912704 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.912834 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.913024 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.913152 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.913330 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.913458 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.913634 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.913825 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.914033 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.914170 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.914297 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.914421 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.914578 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.914708 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.914884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.915020 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.915189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.915311 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.915536 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.915665 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.915842 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.915979 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.916147 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.916274 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.916464 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.916600 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.916775 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.916913 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.917084 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.917212 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.917391 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.917518 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.917699 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.917872 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.918074 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.918204 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.918391 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.918526 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.918700 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.918836 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.919009 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.919137 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.919326 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.919455 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.919637 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.919767 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.919949 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.920085 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.920257 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.920385 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.920577 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.920708 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.920884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.921016 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.921199 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.921336 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.921512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.921641 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.921847 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.921961 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.922159 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.922289 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.922475 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.922571 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.922788 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.923051 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.923148 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.923388 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.923485 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.923708 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.923813 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.924030 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.924145 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.924343 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.924439 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.924661 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.924764 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.924989 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.925092 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.925319 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.925560 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.925670 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.925923 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.926037 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.926250 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.926359 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.926573 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.926669 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.926878 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.926972 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.927190 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.927294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.927497 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.927593 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.927803 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.927898 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.928640 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.928790 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.928963 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.929066 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.929316 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.929412 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.929628 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.929723 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.929963 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.930106 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.930269 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.930397 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.930587 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.930727 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.930894 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.931017 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.931202 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.931337 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.931507 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.931636 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.931813 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.931948 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.932120 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.932249 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.932467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.932605 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.932741 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.932868 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.933001 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.933127 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.933313 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.933450 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.933628 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.933757 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.933952 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.934081 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.934287 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.934425 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.934561 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.934688 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.934868 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.934997 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.935177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.935316 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.935468 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.935596 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.935831 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.935972 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.936107 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.936232 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.936412 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.936550 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.936723 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.936903 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.937050 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.937262 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.937395 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.937521 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.937649 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.937774 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.937939 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.938067 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.938245 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.938374 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.938556 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.938699 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.938860 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.938990 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.939169 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.939298 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.939475 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.939614 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.939790 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.939923 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.940099 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.940228 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.940406 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.940548 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.940710 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.940839 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.941017 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.941137 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.941322 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.941458 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.941628 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.941758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.941957 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.942088 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.942269 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.942409 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.942630 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.942760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.942892 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.943020 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.943153 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.943280 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.943458 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.943657 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.944367 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.944621 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.944909 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945046 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945183 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945309 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945434 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945559 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945682 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945830 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.945972 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.946107 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.946235 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.946359 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.946493 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.946619 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.946767 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.946896 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.947075 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.947214 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.947387 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.947518 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.947713 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.947843 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.948027 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.948164 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.948332 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.948464 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.948639 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.948766 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.948945 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.949082 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.949253 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.949383 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.949560 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.949689 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.949891 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.950036 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.950198 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.950329 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.950502 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.950632 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.950807 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.950938 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.951113 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.951235 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.951419 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.951549 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.951744 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.951884 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.952053 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.952183 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.952359 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.952544 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.952767 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.952904 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.953030 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.953155 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.953279 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.953412 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.953553 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.953679 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.953873 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.954005 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.954201 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.954344 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.954515 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.954728 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.954857 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.954982 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.955106 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.955240 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.955408 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.955545 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.955754 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.955893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.956058 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.956204 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.956376 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.956505 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.956688 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.956817 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.957002 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.957140 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.957309 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.957437 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.957614 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.957744 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.957964 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.958105 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.958281 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.958410 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.958589 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.958717 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.958916 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.959043 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.959310 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.959714 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.959832 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.959940 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.959940 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.960187 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.960312 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.960445 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.960571 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.960695 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.960829 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.960957 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.961082 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.961206 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.961407 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.961536 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.961735 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.961891 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.962074 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.962202 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.962391 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.962531 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.962698 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.962904 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.963045 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.963178 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.963304 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.963438 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.963597 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.963733 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.963904 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.964034 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.964208 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.964345 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.964522 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.964649 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.964852 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.964991 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.965118 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.965253 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.965416 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.965545 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.965721 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.965900 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.966064 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.966195 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.966373 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.966501 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.966677 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.966804 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.967007 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.967152 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.967320 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.967455 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.967627 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.967755 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.967938 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.968107 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.968257 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.968382 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.968547 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.968684 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.968856 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.968993 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.969199 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.969326 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.969590 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.969725 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.969932 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.970063 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.970247 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.970377 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.970560 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.970696 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.970870 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.970999 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.971175 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.971303 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.971488 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.971626 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.971805 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.971933 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.972107 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.972242 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.972414 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.972552 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.972720 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.972950 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.973097 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.973230 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.973365 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.973494 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.973625 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.973785 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.974069 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.974197 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.974383 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.974515 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.974690 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.974873 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.975178 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.975309 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.975494 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.975707 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.975837 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.976030 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.976161 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.976360 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.976503 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.976685 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.976890 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.977026 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.977206 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.977348 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.977515 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.977646 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.977941 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.978074 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.978272 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.978413 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.978584 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.978734 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.978903 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.979032 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.979222 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.979351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.979530 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.979668 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.979842 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.979970 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.980162 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.980291 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.980476 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.980613 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.980799 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.980937 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.981117 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.981245 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.981438 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.981574 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.981758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.981936 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.982112 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.982250 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.982443 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.982574 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.982768 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.982905 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.983081 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.983214 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.983392 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.983500 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.983701 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.983805 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.984007 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.984111 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.984332 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.984436 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.984641 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.984737 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.984954 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.985050 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.985274 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.985371 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.985586 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.985682 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.985915 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.986045 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.986224 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.986320 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.986549 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.986644 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.986853 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.986956 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.987177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.987285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.987492 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.987585 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.987806 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.987909 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.988114 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.988208 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.988421 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.988515 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.988738 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.988844 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.989044 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.989138 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.989350 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.989445 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.989656 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.989752 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.989987 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.990083 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.990322 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.990409 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.991277 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.991419 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.991513 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.991612 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.991806 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.991937 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.992115 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.992270 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.992426 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.992584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.992735 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.992921 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.993045 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.993248 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.993391 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.993566 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.993703 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.993911 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.994050 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.994240 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.994411 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.994547 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.994746 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.994847 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.995063 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.995150 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.995422 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.995520 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.995741 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.995837 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.996047 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.996134 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.996358 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.996453 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.996661 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.996757 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.996964 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.997051 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.997266 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.997352 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.997575 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.997663 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.997904 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.998007 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.998217 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.998341 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.998528 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.998624 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.998835 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.998926 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.999141 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.999236 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.999446 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.999534 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.999749 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:14.999835 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.000074 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.000170 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.000385 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.000474 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.000712 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.000799 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.001031 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.001125 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.001340 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.001428 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.001649 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.001736 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.001983 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.002100 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.002317 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.002413 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.002625 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.002721 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.002942 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.003038 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.003261 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.003344 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.003578 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.003665 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.003897 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.003994 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.004206 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.004299 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.004512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.004605 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.004828 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.004917 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.005145 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.005231 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.005462 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.005548 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.005793 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.006022 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.006744 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.006895 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.007098 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.007317 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.007483 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.007568 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.007727 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.007816 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.008050 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.008137 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.008373 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.008461 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.008694 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.008781 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.009035 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.009218 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.009349 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.009556 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.009644 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.009901 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.010004 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.010223 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.010312 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.010541 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.010638 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.010868 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.010962 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.011188 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.011277 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.011509 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.011597 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.011825 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.011920 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.012164 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.012252 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.012484 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.012571 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.012819 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.012915 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.013128 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.013223 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.013448 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.013536 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.013766 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.013878 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.014111 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.014199 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.014428 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.014516 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.014745 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.014836 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.015065 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.015166 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.015378 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.015467 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.015696 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.015786 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.016009 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.016096 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.016326 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.016424 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.016643 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.016732 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.016969 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.017046 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.017307 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.017396 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.017626 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.017713 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.017968 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.018073 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.018288 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.018388 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.018603 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.018691 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.018919 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.019120 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.019239 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.019437 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.019559 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.019773 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.019888 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.020101 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.020228 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.020427 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.020552 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.020746 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.020877 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.021065 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.021196 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.021393 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.021517 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.021723 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.022062 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.022166 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.022372 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.022461 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.022684 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.022772 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.022991 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.023091 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.023313 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.023402 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.023622 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.023709 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.023929 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.024027 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.024252 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.024345 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.024562 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.024649 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.024917 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.025091 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.025233 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.025441 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.025529 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.025764 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.025899 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.026122 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.026211 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.026452 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.026540 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.026773 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.026868 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.027082 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.027168 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.027395 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.027477 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.027704 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.027955 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.028307 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.028571 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.028658 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.028883 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.028968 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.029193 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.029277 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.029501 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.029590 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.029827 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.029930 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.030150 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.030239 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.030458 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.030554 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.030778 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.030885 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.031081 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.031169 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.031396 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.031483 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.031709 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.031804 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.032016 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.032111 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.032323 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.032409 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.032633 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.032732 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.032942 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.033028 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.033247 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.033333 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.033554 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.033642 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.033893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.033985 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.034208 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.034307 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.034516 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.034612 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.034823 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.034909 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.035128 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.035220 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.035440 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.035527 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.035749 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.035836 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.036055 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.036136 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.036365 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.036452 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.036672 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.036759 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.036986 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.037081 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.037294 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.037456 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.037633 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.037713 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.037970 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.038082 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.038298 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.038387 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.038612 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.038699 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.038926 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.039022 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.039276 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.039362 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.039591 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.039679 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.039899 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.040120 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.040209 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.040458 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.040555 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.040781 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.040876 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.041115 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.041202 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.041447 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.041534 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.041756 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.041876 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.042099 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.042187 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.042407 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.042495 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.042732 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.042966 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.043063 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.043311 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.043398 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.043641 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.043736 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.043956 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.044045 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.044268 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.044355 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.044581 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.044748 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.044893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.044982 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.045205 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.045293 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.045519 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.045619 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.045878 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.045971 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.046200 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.046330 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.046517 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.046618 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.046826 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.046913 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.047139 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.047226 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.047454 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.047542 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.047768 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.047856 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.048080 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.048168 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.048393 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.048481 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.048705 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.048793 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.049017 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.049102 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.049325 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.049412 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.049633 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.049727 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.049969 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.050072 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.050290 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.050378 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.050625 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.050722 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.050941 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.051037 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.051247 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.051334 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.051583 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.051668 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.051901 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.051997 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.052214 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.052302 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.052528 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.052623 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.052840 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.052929 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.053692 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.053781 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.054119 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.054213 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.054441 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.054529 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.054767 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.054855 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.055082 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.055191 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.055415 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.055511 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.055761 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.055851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.056095 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.056191 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.056424 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.056511 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.056734 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.056821 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.057042 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.057138 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.057356 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.057473 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.057671 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.057936 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.058037 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.058122 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.058319 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.058412 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.058628 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.058725 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.058936 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.059025 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.059247 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.059341 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.059555 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.059652 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.059864 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.059961 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.060170 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.060258 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.060478 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.060565 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.060787 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.060883 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.061091 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.061218 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.061395 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.061482 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.061698 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.061787 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.062030 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.062120 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.062335 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.062440 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.062640 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.062735 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.062949 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.063037 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.063255 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.063351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.063563 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.063652 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.063867 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.063953 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.064221 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.064322 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.064476 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.064565 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.064783 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.064872 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.065090 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.065204 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.065398 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.065514 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.068163 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.068315 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.068450 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.068561 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.069316 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.069434 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.069540 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.069647 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.069764 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.069902 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070010 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070115 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070234 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070343 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070343 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070553 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070553 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070827 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070827 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.070994 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071076 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071155 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071251 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071333 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071421 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071503 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071582 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071661 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071740 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071827 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071915 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.071997 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072076 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072154 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072232 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072311 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072398 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072478 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072557 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072636 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072715 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072793 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072880 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.072967 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.073049 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.073262 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.073351 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.073575 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.073664 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.073950 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.074043 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.074279 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.074368 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.074591 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.074680 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.074900 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.074988 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.075225 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.075349 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.075547 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.075674 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.075868 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.076144 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.076239 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.076477 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.076586 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.076787 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.076890 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.077117 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.077354 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.077498 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.077705 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.077822 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.078085 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.078183 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.078381 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.078488 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.078702 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.078805 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.079033 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.079127 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.079352 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.079445 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.079672 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.079765 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.079985 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.080078 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.080239 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:14:15.080360 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.080648 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.080976 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.081327 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.081661 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.082006 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.082325 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.082637 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:14:15.082886 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:14:15.233704 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Registered counter for database nova_api Jun 20 12:14:15.237575 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Registered counter for database nova_api Jun 20 12:14:15.254850 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.258843 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.261962 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.265338 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.320522 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.context [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1005ee0f-ec24-457d-9b36-b8a9b0504dd6(cell1) {{(pid=103693) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 12:14:15.323720 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.context [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1005ee0f-ec24-457d-9b36-b8a9b0504dd6(cell1) {{(pid=103692) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 12:14:15.324433 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.326049 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.326855 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.327751 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.336466 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_concurrency.lockutils [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.336613 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.336613 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:14:15.336783 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Registered counter for database nova_cell0 Jun 20 12:14:15.336868 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:14:15.336868 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Registered counter for database nova_cell0 Jun 20 12:14:15.337030 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Registered counter for database nova_cell1 Jun 20 12:14:15.339118 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Registered counter for database nova_cell1 Jun 20 12:14:15.342901 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.344709 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.346684 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.349241 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.350768 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.353004 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.354354 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.357145 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.498272 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO dbcounter [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Registered counter for database nova_cell0 Jun 20 12:14:15.503728 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Registered counter for database nova_cell0 Jun 20 12:14:15.507475 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG oslo_db.sqlalchemy.engines [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.511950 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writer thread running {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.512921 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:14:15.517184 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:14:15.951366 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:14:15.955855 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:14:15.958809 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:14:15.963373 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:14:16.310897 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:14:16.316912 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:14:16.318308 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:14:16.322404 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55893989f9c0 pid: 103692 (default app) Jun 20 12:14:16.324463 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:14:16.324690 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: WARNING keystonemiddleware.auth_token [None req-86c9920a-f4a4-4d61-ad56-222424bfbd14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:14:16.325687 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Jun 20 12:14:16.326125 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Mon Jun 20 12:14:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:14:16.329937 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55893989f9c0 pid: 103693 (default app) Jun 20 12:15:35.829297 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:35.830398 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jun 20 12:15:35.831228 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:35.843720 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:SELECT=3 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:35.846524 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell0:SELECT=3 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:35.846524 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell1:SELECT=3 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:35.847211 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:36.326317 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b7437c5b-ca47-4282-a87f-2ac16476230b admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:36.357348 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b7437c5b-ca47-4282-a87f-2ac16476230b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.519093 Jun 20 12:15:36.358351 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 20 12:15:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:38.530430 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:38.531438 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-69b9ec9f-402f-4e6b-aa82-88c5709dd470 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 20 12:15:38.531851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:15:38.611281 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-ea27869c-4731-4c48-876e-6ed0033a1df5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "id": "c1", "swap": 0, "vcpus": 1}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:38.631344 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:15:38.631344 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: warnings.warn(msg) Jun 20 12:15:38.726673 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-ea27869c-4731-4c48-876e-6ed0033a1df5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.188385 Jun 20 12:15:38.727699 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:15:38.971540 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-3cea73ef-9838-4133-9950-56c2683eac95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:38.974026 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:15:38.974026 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 20 12:15:38.976718 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=3 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:38.977626 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell1:SELECT=3 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:39.003228 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell0:SELECT=3 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:39.003228 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:39.135736 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-3cea73ef-9838-4133-9950-56c2683eac95 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.399657 Jun 20 12:15:39.136440 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 20 12:15:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:41.292491 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-ea27869c-4731-4c48-876e-6ed0033a1df5 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:41.293543 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-ea27869c-4731-4c48-876e-6ed0033a1df5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jun 20 12:15:41.294144 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:41.425627 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-8661828f-4533-428c-a39a-2f33398b1469 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:41.443067 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:15:41.443067 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 20 12:15:41.556749 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-8661828f-4533-428c-a39a-2f33398b1469 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.256669 Jun 20 12:15:41.559139 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:41.569099 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-3a10b847-fac1-4c43-8e40-9572249fc3b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:41.570620 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:15:41.570620 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: warnings.warn(msg) Jun 20 12:15:41.706824 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-3a10b847-fac1-4c43-8e40-9572249fc3b1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141312 Jun 20 12:15:41.707414 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 20 12:15:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:43.812232 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-8661828f-4533-428c-a39a-2f33398b1469 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:43.814518 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-8661828f-4533-428c-a39a-2f33398b1469 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Jun 20 12:15:43.814518 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:43.877233 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-2073e07b-e60f-42bb-9a53-4fd212899014 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "disk": 10}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:43.986443 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-2073e07b-e60f-42bb-9a53-4fd212899014 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166204 Jun 20 12:15:43.987114 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:43.999821 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-837c0734-6da7-4a51-88d6-a3d78e5d6cb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:44.097232 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-837c0734-6da7-4a51-88d6-a3d78e5d6cb6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101262 Jun 20 12:15:44.098400 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 20 12:15:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:46.222658 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-2073e07b-e60f-42bb-9a53-4fd212899014 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:46.223685 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-2073e07b-e60f-42bb-9a53-4fd212899014 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 20 12:15:46.224089 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:46.282815 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-b394c357-cb99-4231-bd55-fc1eadd7928c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:46.391006 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-b394c357-cb99-4231-bd55-fc1eadd7928c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160934 Jun 20 12:15:46.391589 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:46.405174 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-62deae33-64dc-44ce-a98f-782f3ffb2b7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:46.501719 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-62deae33-64dc-44ce-a98f-782f3ffb2b7f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101226 Jun 20 12:15:46.502361 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 20 12:15:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:48.616146 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-b394c357-cb99-4231-bd55-fc1eadd7928c admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:48.617155 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-b394c357-cb99-4231-bd55-fc1eadd7928c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 20 12:15:48.617557 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:48.684392 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b8de39ee-2eb9-497d-9234-14b45b48bdb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:48.780242 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b8de39ee-2eb9-497d-9234-14b45b48bdb9 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156757 Jun 20 12:15:48.787963 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:48.793959 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-55cf803e-b1bc-444d-a266-1570f6801b5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:48.908795 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-55cf803e-b1bc-444d-a266-1570f6801b5a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119434 Jun 20 12:15:48.909410 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 20 12:15:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:50.998053 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b8de39ee-2eb9-497d-9234-14b45b48bdb9 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:50.999308 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b8de39ee-2eb9-497d-9234-14b45b48bdb9 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 20 12:15:50.999710 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:51.062891 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-c727a7c8-c737-495b-a1ea-7b1dd8e1f092 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:51.087055 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-c727a7c8-c737-495b-a1ea-7b1dd8e1f092 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081439 Jun 20 12:15:51.088239 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 20 12:15:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:15:53.230710 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-b8de39ee-2eb9-497d-9234-14b45b48bdb9 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:53.231779 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-b8de39ee-2eb9-497d-9234-14b45b48bdb9 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 20 12:15:53.232217 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:53.304273 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-48a2773e-eafc-4cac-b263-f65eed394468 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:53.409621 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-48a2773e-eafc-4cac-b263-f65eed394468 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.171198 Jun 20 12:15:53.410348 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:53.423141 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19ef8e16-b336-470a-b4b9-70df3444e613 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:53.560140 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19ef8e16-b336-470a-b4b9-70df3444e613 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140743 Jun 20 12:15:53.560737 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 20 12:15:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:55.733251 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-48a2773e-eafc-4cac-b263-f65eed394468 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:55.734450 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-48a2773e-eafc-4cac-b263-f65eed394468 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Jun 20 12:15:55.734860 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:55.794129 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-9a119ff3-7d1f-4f12-9074-a444560ac395 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:55.873859 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-9a119ff3-7d1f-4f12-9074-a444560ac395 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132916 Jun 20 12:15:55.874425 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:55.889090 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-140eb799-5d3f-4a44-93cb-9d551658ddc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:56.062872 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-140eb799-5d3f-4a44-93cb-9d551658ddc1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.177664 Jun 20 12:15:56.065146 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 20 12:15:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:15:58.474000 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-9a119ff3-7d1f-4f12-9074-a444560ac395 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:15:58.475087 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-9a119ff3-7d1f-4f12-9074-a444560ac395 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 20 12:15:58.475490 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:15:58.535261 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-d876553a-431a-4f17-8c8f-3360c1fee11e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:58.612601 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-d876553a-431a-4f17-8c8f-3360c1fee11e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.130457 Jun 20 12:15:58.613156 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:15:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:15:58.625126 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-22cf617c-26a9-4f82-be13-72bf48d0e91a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:15:58.714193 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-22cf617c-26a9-4f82-be13-72bf48d0e91a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092448 Jun 20 12:15:58.714733 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 20 12:15:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:00.829764 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-d876553a-431a-4f17-8c8f-3360c1fee11e admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:00.831299 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-d876553a-431a-4f17-8c8f-3360c1fee11e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Jun 20 12:16:00.831696 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:00.896976 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-74fa1d29-9507-4599-85ef-1f675b4ed4cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:00.989700 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-74fa1d29-9507-4599-85ef-1f675b4ed4cc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151187 Jun 20 12:16:00.990431 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:16:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:16:01.002292 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-5e125189-1fc8-4c9c-b662-546ecdab6e3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:01.102439 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-5e125189-1fc8-4c9c-b662-546ecdab6e3b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103629 Jun 20 12:16:01.121980 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 20 12:16:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:03.229400 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-74fa1d29-9507-4599-85ef-1f675b4ed4cc admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:03.231455 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-74fa1d29-9507-4599-85ef-1f675b4ed4cc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002421 Jun 20 12:16:03.232613 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:03.301593 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-2b9771b7-9211-44f1-b14d-2bd94dd8779b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:03.772638 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-2b9771b7-9211-44f1-b14d-2bd94dd8779b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.533415 Jun 20 12:16:03.779408 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 20 12:16:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:03.786092 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-0441537f-c8cc-4190-8b2c-eba3d37a9a22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:03.894431 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-0441537f-c8cc-4190-8b2c-eba3d37a9a22 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111918 Jun 20 12:16:03.895306 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 20 12:16:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:16:28.533462 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-2b9771b7-9211-44f1-b14d-2bd94dd8779b admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:28.534501 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-2b9771b7-9211-44f1-b14d-2bd94dd8779b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 20 12:16:28.534898 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:28.546027 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:28.594723 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-92b55342-fe63-4402-bfc9-08a6598c589b admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:28.612888 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-92b55342-fe63-4402-bfc9-08a6598c589b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071458 Jun 20 12:16:28.613423 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 20 12:16:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:29.532394 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-2b9771b7-9211-44f1-b14d-2bd94dd8779b admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:29.533499 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-2b9771b7-9211-44f1-b14d-2bd94dd8779b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 20 12:16:29.534075 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:29.727118 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-a458579a-ccf0-4437-91b8-b6757d99c30c admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:29.733153 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.wsgi [None req-a458579a-ccf0-4437-91b8-b6757d99c30c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-a458579a-ccf0-4437-91b8-b6757d99c30c admin admin] Request method failure captured: Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Accept: application/json Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Accept-Encoding: gzip, deflate Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Connection: keep-alive Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Content-Length: 0 Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Host: 10.222.0.64 Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Openstack-Api-Version: compute 2.90 Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Openstack-System-Scope: None Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: User-Agent: python-novaclient Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Auth-Token: gAAAAABisGUdweeDKluMUDj3x_WQfdG5MhWNqBmzm581j_nGICoUizRaIEdLnxkhH__Y_Xloyb7BewsbY-xcsTy_sWAo-Zu7KAdyi2UpmgzhU-b1auaS4uXT4rJ8o3w_w9nw2uD0X9S59zmvEsoqEQCm1W2xFB1YC3DjNJqPIBSvCFFmSEYzqng Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Domain-Id: None Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Domain-Name: None Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Identity-Status: Confirmed Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Is-Admin-Project: True Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Domain-Id: default Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Domain-Name: Default Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Name: admin Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Role: admin,reader,member Jun 20 12:16:29.736512 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Roles: admin,reader,member Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}] Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant: admin Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant-Name: admin Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User: admin Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Domain-Id: default Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Domain-Name: Default Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Id: c92fa328437c4093a3eddeda8c856c28 Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Name: admin Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: method: > Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: exception: Flavor 42 could not be found. Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: action_args: {'id': '42'} Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:29.743457 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:29.744467 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.745789 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-a458579a-ccf0-4437-91b8-b6757d99c30c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:29.747089 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-a458579a-ccf0-4437-91b8-b6757d99c30c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063721 Jun 20 12:16:29.747089 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 20 12:16:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:29.748402 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-6535562f-cbe8-4b80-9c12-1b05c8b4e0a0 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:29.751326 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:29.769981 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-6535562f-cbe8-4b80-9c12-1b05c8b4e0a0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025156 Jun 20 12:16:29.770516 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 20 12:16:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:29.780949 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-9f3b43b1-ff0f-4f06-bb42-bcf3342d174d admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:29.804474 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-9f3b43b1-ff0f-4f06-bb42-bcf3342d174d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027290 Jun 20 12:16:29.805206 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 20 12:16:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:29.814835 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-1187d439-03cf-45fb-a20c-ab80e8e15df0 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:29.821090 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.wsgi [None req-1187d439-03cf-45fb-a20c-ab80e8e15df0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-1187d439-03cf-45fb-a20c-ab80e8e15df0 admin admin] Request method failure captured: Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Accept: application/json Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Accept-Encoding: gzip, deflate Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Connection: keep-alive Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Content-Length: 0 Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Host: 10.222.0.64 Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Openstack-Api-Version: compute 2.90 Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Openstack-System-Scope: None Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: User-Agent: python-novaclient Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Auth-Token: gAAAAABisGUdweeDKluMUDj3x_WQfdG5MhWNqBmzm581j_nGICoUizRaIEdLnxkhH__Y_Xloyb7BewsbY-xcsTy_sWAo-Zu7KAdyi2UpmgzhU-b1auaS4uXT4rJ8o3w_w9nw2uD0X9S59zmvEsoqEQCm1W2xFB1YC3DjNJqPIBSvCFFmSEYzqng Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Domain-Id: None Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Domain-Name: None Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Identity-Status: Confirmed Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Is-Admin-Project: True Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Domain-Id: default Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Domain-Name: Default Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Name: admin Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Role: admin,reader,member Jun 20 12:16:29.824504 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Roles: admin,reader,member Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}] Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant: admin Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant-Name: admin Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User: admin Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Domain-Id: default Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Domain-Name: Default Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Id: c92fa328437c4093a3eddeda8c856c28 Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Name: admin Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: method: > Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: exception: Flavor 42 could not be found. Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: action_args: {'id': '42'} Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:29.830294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:29.831240 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:29.832532 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-1187d439-03cf-45fb-a20c-ab80e8e15df0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:29.833892 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-1187d439-03cf-45fb-a20c-ab80e8e15df0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014878 Jun 20 12:16:29.833892 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 20 12:16:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:30.644603 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-9f3b43b1-ff0f-4f06-bb42-bcf3342d174d admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:30.645616 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-9f3b43b1-ff0f-4f06-bb42-bcf3342d174d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 20 12:16:30.646051 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:30.837660 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-868b3080-30d2-4612-9750-b449ca3b86ee admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:30.843661 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.wsgi [None req-868b3080-30d2-4612-9750-b449ca3b86ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-868b3080-30d2-4612-9750-b449ca3b86ee admin admin] Request method failure captured: Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Accept: application/json Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Accept-Encoding: gzip, deflate Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Connection: keep-alive Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Content-Length: 0 Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Host: 10.222.0.64 Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Openstack-Api-Version: compute 2.90 Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Openstack-System-Scope: None Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: User-Agent: python-novaclient Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Auth-Token: gAAAAABisGUeAMiZLwEXs1H1AfiuMn3u7zVHE67ZjAiip-CWptn1QnmjZP5PhsP5ckjMYRF159PPefjpCVf1Lg_J_oNzzcizx9ohIN_x5r7XVLzHsy07PSfjtOYA4xAsFWysgO8_6-d0nSUCsj9RLJrznB0ci0-gbUlPXjIpIX4Iw764lTkEVs8 Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Domain-Id: None Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Domain-Name: None Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Identity-Status: Confirmed Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Is-Admin-Project: True Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Domain-Id: default Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Domain-Name: Default Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Name: admin Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Role: admin,reader,member Jun 20 12:16:30.845177 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Roles: admin,reader,member Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}] Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant: admin Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant-Name: admin Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User: admin Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Domain-Id: default Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Domain-Name: Default Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Id: c92fa328437c4093a3eddeda8c856c28 Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Name: admin Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: method: > Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: exception: Flavor 84 could not be found. Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: action_args: {'id': '84'} Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:30.846758 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:30.847851 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.849351 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-868b3080-30d2-4612-9750-b449ca3b86ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:30.850642 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-868b3080-30d2-4612-9750-b449ca3b86ee admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061347 Jun 20 12:16:30.850642 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 20 12:16:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:30.857230 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-46a5ee7e-8d92-4571-8a29-695055439101 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:30.871124 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-46a5ee7e-8d92-4571-8a29-695055439101 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017563 Jun 20 12:16:30.871685 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 20 12:16:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:16:30.881282 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-3a2d1726-3867-43fd-8ce6-904d487fe071 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:30.897284 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-3a2d1726-3867-43fd-8ce6-904d487fe071 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019790 Jun 20 12:16:30.897844 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 20 12:16:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:16:30.917386 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-f32824f5-411b-4ce4-8683-82e6e26ad023 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:30.922798 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.wsgi [None req-f32824f5-411b-4ce4-8683-82e6e26ad023 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-f32824f5-411b-4ce4-8683-82e6e26ad023 admin admin] Request method failure captured: Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Accept: application/json Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Accept-Encoding: gzip, deflate Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Connection: keep-alive Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Content-Length: 0 Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Host: 10.222.0.64 Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Openstack-Api-Version: compute 2.90 Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Openstack-System-Scope: None Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: User-Agent: python-novaclient Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Auth-Token: gAAAAABisGUeAMiZLwEXs1H1AfiuMn3u7zVHE67ZjAiip-CWptn1QnmjZP5PhsP5ckjMYRF159PPefjpCVf1Lg_J_oNzzcizx9ohIN_x5r7XVLzHsy07PSfjtOYA4xAsFWysgO8_6-d0nSUCsj9RLJrznB0ci0-gbUlPXjIpIX4Iw764lTkEVs8 Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Domain-Id: None Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Domain-Name: None Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Identity-Status: Confirmed Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Is-Admin-Project: True Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Domain-Id: default Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Domain-Name: Default Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Name: admin Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Role: admin,reader,member Jun 20 12:16:30.924285 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Roles: admin,reader,member Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}] Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant: admin Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant-Name: admin Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User: admin Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Domain-Id: default Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Domain-Name: Default Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Id: c92fa328437c4093a3eddeda8c856c28 Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Name: admin Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: method: > Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: exception: Flavor 84 could not be found. Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: action_args: {'id': '84'} Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:30.925893 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:30.926884 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:30.928189 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-f32824f5-411b-4ce4-8683-82e6e26ad023 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:30.929586 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-f32824f5-411b-4ce4-8683-82e6e26ad023 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012243 Jun 20 12:16:30.929586 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 20 12:16:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:31.753398 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-3a2d1726-3867-43fd-8ce6-904d487fe071 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:31.754425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-3a2d1726-3867-43fd-8ce6-904d487fe071 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 20 12:16:31.754849 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:31.947673 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-f7de80f6-31f2-414a-86c7-0070a61187b2 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:31.953094 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.wsgi [None req-f7de80f6-31f2-414a-86c7-0070a61187b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-f7de80f6-31f2-414a-86c7-0070a61187b2 admin admin] Request method failure captured: Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Accept: application/json Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Accept-Encoding: gzip, deflate Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Connection: keep-alive Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Content-Length: 0 Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Host: 10.222.0.64 Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Openstack-Api-Version: compute 2.90 Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Openstack-System-Scope: None Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: User-Agent: python-novaclient Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Auth-Token: gAAAAABisGUfelJ3zvDneiQkhC7ndljWG0MVbyO7XHy0WAqRe5ul7UyfETS6xtQeQLgLhMx-cBjqPvoG7hgz_FWvHsjm6FwjvdWD-K7QIdSUlB07EX4s-cEJ8nuPealiMeiU8gH3BKlqIjWnEcG59LEjXH4ui8Zr61sQm-JJF8yzQsyxAG170lc Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Domain-Id: None Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Domain-Name: None Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Identity-Status: Confirmed Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Is-Admin-Project: True Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Domain-Id: default Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Domain-Name: Default Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Project-Name: admin Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Role: admin,reader,member Jun 20 12:16:31.954650 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Roles: admin,reader,member Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}] Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant: admin Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-Tenant-Name: admin Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User: admin Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Domain-Id: default Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Domain-Name: Default Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Id: c92fa328437c4093a3eddeda8c856c28 Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: X-User-Name: admin Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: method: > Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: exception: Flavor 451 could not be found. Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: action_args: {'id': '451'} Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:31.956246 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:31.957236 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: ERROR nova.api.openstack.wsgi Jun 20 12:16:31.958584 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-f7de80f6-31f2-414a-86c7-0070a61187b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:31.959937 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-f7de80f6-31f2-414a-86c7-0070a61187b2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061046 Jun 20 12:16:31.959937 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 20 12:16:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 12:16:31.966714 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-5303f827-d618-4f53-9900-8119dd266856 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:31.980588 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-5303f827-d618-4f53-9900-8119dd266856 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017818 Jun 20 12:16:31.981117 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 20 12:16:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:16:31.990919 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:32.005615 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018734 Jun 20 12:16:32.008286 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 20 12:16:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:16:32.016341 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-ee1366a7-6393-418b-aae2-d519da2e67b4 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:32.021604 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.wsgi [None req-ee1366a7-6393-418b-aae2-d519da2e67b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-ee1366a7-6393-418b-aae2-d519da2e67b4 admin admin] Request method failure captured: Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Accept: application/json Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Accept-Encoding: gzip, deflate Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Connection: keep-alive Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Content-Length: 0 Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Host: 10.222.0.64 Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Openstack-Api-Version: compute 2.90 Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Openstack-System-Scope: None Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: User-Agent: python-novaclient Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Auth-Token: gAAAAABisGUfelJ3zvDneiQkhC7ndljWG0MVbyO7XHy0WAqRe5ul7UyfETS6xtQeQLgLhMx-cBjqPvoG7hgz_FWvHsjm6FwjvdWD-K7QIdSUlB07EX4s-cEJ8nuPealiMeiU8gH3BKlqIjWnEcG59LEjXH4ui8Zr61sQm-JJF8yzQsyxAG170lc Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Domain-Id: None Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Domain-Name: None Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Identity-Status: Confirmed Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Is-Admin-Project: True Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Domain-Id: default Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Domain-Name: Default Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Project-Name: admin Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Role: admin,reader,member Jun 20 12:16:32.023425 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Roles: admin,reader,member Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f7b8b3cd4a74f7eb74d84f735aad86f"}]}] Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant: admin Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant-Id: 1f7b8b3cd4a74f7eb74d84f735aad86f Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-Tenant-Name: admin Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User: admin Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Domain-Id: default Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Domain-Name: Default Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Id: c92fa328437c4093a3eddeda8c856c28 Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: X-User-Name: admin Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: method: > Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: exception: Flavor 451 could not be found. Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: action_args: {'id': '451'} Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:16:32.024865 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:32.025760 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 20 12:16:32.026847 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-ee1366a7-6393-418b-aae2-d519da2e67b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:16:32.028329 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-ee1366a7-6393-418b-aae2-d519da2e67b4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012049 Jun 20 12:16:32.028329 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 20 12:16:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:32.847670 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:32.848692 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 20 12:16:32.849096 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:33.038493 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-57bd1d6c-3079-4584-b8a3-f7afe8047754 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:33.119969 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-57bd1d6c-3079-4584-b8a3-f7afe8047754 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.133203 Jun 20 12:16:33.120530 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 20 12:16:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:33.950291 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:33.951304 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 20 12:16:33.951703 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:34.143967 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-8d0615c5-dc83-4c05-8c56-44912f8fc11f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:34.231783 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-8d0615c5-dc83-4c05-8c56-44912f8fc11f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.139078 Jun 20 12:16:34.232345 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 20 12:16:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:35.059165 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:35.060173 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 20 12:16:35.060573 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:35.262779 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-835a5ff6-46bd-4f61-b921-143f7dbfec89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:35.365483 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-835a5ff6-46bd-4f61-b921-143f7dbfec89 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.155198 Jun 20 12:16:35.366147 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 20 12:16:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:36.197971 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:36.199012 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 20 12:16:36.199412 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:36.388965 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-82975584-a3e8-4031-8d83-3e8adbfe3360 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:16:36.485958 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-82975584-a3e8-4031-8d83-3e8adbfe3360 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.148252 Jun 20 12:16:36.486515 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 20 12:16:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:16:37.321302 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:37.322173 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 20 12:16:37.322571 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:16:37.513263 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-a2fc016b-dc3f-48f6-9ee5-b570805b7f9b admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:16:37.532395 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-a2fc016b-dc3f-48f6-9ee5-b570805b7f9b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071625 Jun 20 12:16:37.532934 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Mon Jun 20 12:16:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:17:24.815240 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.825403 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-19d2407a-ea89-462e-8c03-11e1441cfeaa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 20 12:17:24.825403 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:17:24.827557 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:24.879006 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-2bea8e28-8a68-4fd6-ba9f-d66876c6945e admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.898469 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-2bea8e28-8a68-4fd6-ba9f-d66876c6945e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075105 Jun 20 12:17:24.898967 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:17:24.923866 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-7a6860e5-5c54-4f6d-9f14-f255f07bc546 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.928205 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG dbcounter [-] [103693] Writing DB stats nova_api:SELECT=14 {{(pid=103693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:24.934975 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-7a6860e5-5c54-4f6d-9f14-f255f07bc546 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014511 Jun 20 12:17:24.935940 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:24.949428 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-358466e2-b9ba-44c2-94bd-784c785e4fee admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.957596 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-358466e2-b9ba-44c2-94bd-784c785e4fee admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011791 Jun 20 12:17:24.958193 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:17:24.970472 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.978962 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012418 Jun 20 12:17:24.979490 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:17:24.990663 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-f16380c0-0403-4730-9527-cfa80d9dabf0 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:17:24.998549 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-f16380c0-0403-4730-9527-cfa80d9dabf0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011354 Jun 20 12:17:24.999013 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Mon Jun 20 12:17:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:20:51.679028 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:51.680093 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 20 12:20:51.680491 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:51.823212 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=6 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:51.937049 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-8bfea397-0fe9-4465-8497-8b44721a0ddd admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:51.939992 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:20:51.939992 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 20 12:20:51.939992 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8bfea397-0fe9-4465-8497-8b44721a0ddd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.939992 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8bfea397-0fe9-4465-8497-8b44721a0ddd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:51.940802 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8bfea397-0fe9-4465-8497-8b44721a0ddd admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:51.941254 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8bfea397-0fe9-4465-8497-8b44721a0ddd admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:51.976369 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-8bfea397-0fe9-4465-8497-8b44721a0ddd admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154551 Jun 20 12:20:51.976933 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 20 12:20:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:20:52.812361 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:52.813367 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 20 12:20:52.813763 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:20:53.020187 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-39665b7e-adf6-4698-b4c8-a57e7cf7f72f admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:20:53.021568 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:20:53.021568 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 20 12:20:53.023085 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-39665b7e-adf6-4698-b4c8-a57e7cf7f72f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.023260 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-39665b7e-adf6-4698-b4c8-a57e7cf7f72f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.024049 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-39665b7e-adf6-4698-b4c8-a57e7cf7f72f admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:20:53.024493 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-39665b7e-adf6-4698-b4c8-a57e7cf7f72f admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:20:53.045236 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-39665b7e-adf6-4698-b4c8-a57e7cf7f72f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083848 Jun 20 12:20:53.046076 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 20 12:20:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:21:04.301308 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:04.302356 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 20 12:21:04.302754 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:21:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:04.445933 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell0:SELECT=4 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:04.446628 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell1:SELECT=4 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:04.447162 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=8 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:04.498495 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-49343823-e7f2-47c4-9802-8a53dd1963a0 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:04.499666 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:21:04.499666 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 20 12:21:04.500832 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-49343823-e7f2-47c4-9802-8a53dd1963a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:04.501275 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-49343823-e7f2-47c4-9802-8a53dd1963a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:04.502124 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-49343823-e7f2-47c4-9802-8a53dd1963a0 admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:04.502552 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-49343823-e7f2-47c4-9802-8a53dd1963a0 admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:04.528606 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-49343823-e7f2-47c4-9802-8a53dd1963a0 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087201 Jun 20 12:21:04.529318 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 20 12:21:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:21:05.358705 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: DEBUG nova.api.openstack.wsgi [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] Calling method '>' {{(pid=103693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:05.359758 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: INFO nova.api.openstack.requestlog [None req-8c60c86f-f6f9-4d17-b457-1947a6353a64 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 20 12:21:05.360157 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: [pid: 103693|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 20 12:21:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:21:05.550862 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-1a06764c-f08d-4762-b436-88b45b0b2573 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:21:05.552087 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:21:05.552087 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 20 12:21:05.553294 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-1a06764c-f08d-4762-b436-88b45b0b2573 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:05.553726 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-1a06764c-f08d-4762-b436-88b45b0b2573 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:05.554559 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-1a06764c-f08d-4762-b436-88b45b0b2573 admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:21:05.554977 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-1a06764c-f08d-4762-b436-88b45b0b2573 admin admin] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:21:05.577697 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-1a06764c-f08d-4762-b436-88b45b0b2573 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078600 Jun 20 12:21:05.578214 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 20 12:21:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:22:01.285709 dv-cinder-836973-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 12:22:01.286415 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: Mon Jun 20 12:22:01 2022 - graceful shutdown triggered... Jun 20 12:22:01.286858 dv-cinder-836973-4-iscsi devstack@n-api.service[103693]: Gracefully killing worker 2 (pid: 103693)... Jun 20 12:22:01.287214 dv-cinder-836973-4-iscsi devstack@n-api.service[103692]: Gracefully killing worker 1 (pid: 103692)... Jun 20 12:22:02.287550 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: worker 1 buried after 1 seconds Jun 20 12:22:02.288052 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: worker 2 buried after 1 seconds Jun 20 12:22:02.288052 dv-cinder-836973-4-iscsi devstack@n-api.service[103691]: goodbye to uWSGI. Jun 20 12:22:02.289343 dv-cinder-836973-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 12:22:02.289938 dv-cinder-836973-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 12:22:02.292694 dv-cinder-836973-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 12:22:02.302246 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 12:22:02.304770 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 12:22:02 2022] *** Jun 20 12:22:02.304770 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 12:22:02.304770 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: nodename: dv-cinder-836973-4-iscsi Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: machine: x86_64 Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: clock source: unix Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: pcre jit disabled Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: detected number of CPU cores: 4 Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: current working directory: / Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: detected binary path: /usr/bin/uwsgi-core Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: your processes number limit is 47680 Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: your memory page size is 4096 bytes Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: detected max file descriptor number: 2048 Jun 20 12:22:02.305069 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: lock engine: pthread robust mutexes Jun 20 12:22:02.305728 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: thunder lock: enabled Jun 20 12:22:02.305728 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 12:22:02.305728 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 12:22:02.351996 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: Python main interpreter initialized at 0x563da01469c0 Jun 20 12:22:02.351996 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: python threads support enabled Jun 20 12:22:02.351996 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: your server socket listen backlog is limited to 100 connections Jun 20 12:22:02.351996 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: your mercy for graceful operations on workers is 90 seconds Jun 20 12:22:02.352467 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 12:22:02.352467 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: *** Operational MODE: preforking *** Jun 20 12:22:02.352729 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: *** uWSGI is running in multiple interpreter mode *** Jun 20 12:22:02.352729 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: spawned uWSGI master process (pid: 118073) Jun 20 12:22:02.352938 dv-cinder-836973-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 12:22:02.353786 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: spawned uWSGI worker 1 (pid: 118091, cores: 1) Jun 20 12:22:02.353982 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: spawned uWSGI worker 2 (pid: 118092, cores: 1) Jun 20 12:22:02.354077 dv-cinder-836973-4-iscsi devstack@n-api.service[118073]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 12:22:03.021907 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 12:22:03.030227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 12:22:04.252311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:22:04.252311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: from cryptography.utils import int_from_bytes Jun 20 12:22:04.253013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:22:04.253013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: from cryptography.utils import int_from_bytes Jun 20 12:22:04.253495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:22:04.253495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: from cryptography.utils import int_from_bytes Jun 20 12:22:04.254042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:22:04.254042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: from cryptography.utils import int_from_bytes Jun 20 12:22:06.703836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:22:06.704425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:22:06.704549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:22:06.705108 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:22:06.705389 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:22:06.705780 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.706144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.706480 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.706805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.707149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.707470 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.707799 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.708122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.708455 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.708722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.709041 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.709369 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-4-iscsi {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.709696 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.710045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.710898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.711229 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.711538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.711869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.712186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.712702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.714209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.714209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.714209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.714485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.714753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.715074 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.715385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.715689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.716019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.716328 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.716744 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-4-iscsi {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.717075 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.717384 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.717692 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.718163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.718478 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.718785 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.719109 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.719439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.719746 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.720091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.720414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.720738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.721062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.721368 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.721680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.722027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.722371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.722672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.722979 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.723232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.723542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.723869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.724189 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.724509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.724769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.725020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.725341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.725664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.726833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.727135 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.727291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.727599 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.727950 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.728324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.728641 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.728955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.729280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.729598 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.729948 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.730261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.730584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.730994 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.731250 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.731564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.731912 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.732242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.732487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:22:06.733013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.733172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:22:06.733316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.733316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.733604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:22:06.733757 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.733960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:22:06.734107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.734261 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:22:06.734414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.735341 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.735532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.735629 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.735708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.735789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.735862 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.735943 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736102 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736180 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736276 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736373 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736572 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736572 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736819 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.736904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.737001 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.737094 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.737299 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.737470 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.737620 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.737842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-4-iscsi {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.738039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.738199 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.738379 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.738525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.738684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.738840 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.739008 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.739156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.739298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.739448 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.739591 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.739745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.739906 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.740057 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.740207 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.740357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.740536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.740690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.740844 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.740987 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.741136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.741285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.741442 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.741683 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.741925 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.742686 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.742862 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.743017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.743168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.743312 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.743462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.743620 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.743772 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.743916 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.744058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.744200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.744362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.744519 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-4-iscsi {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.744664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.744813 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.744956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.745107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.745251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.745402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.745556 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.745556 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.745875 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.746040 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.746191 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.746345 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.746506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.746726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.746873 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.747024 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.747192 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.747929 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.748084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.748238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.748383 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.748541 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.748695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.748851 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.749004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.749147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.749297 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.749451 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.749595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.749743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.749948 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.750101 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.750253 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.750408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.750551 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.750702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.750864 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.751008 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.751159 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.751309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.751452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.751593 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.751744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.751889 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.752040 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.752200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.752586 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.752911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.753070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.753070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.753377 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.753521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.753672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.753855 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.754006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.754164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.754315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.754458 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.754600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.754751 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.754914 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.755059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.755209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.755352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.755501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.755654 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.755811 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.755964 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.756114 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.756306 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.756462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.756612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.756869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.757444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.757722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.758043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.758224 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.758388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.758540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.758692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.758841 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.758991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.759145 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.759305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.759448 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.759610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.759754 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.759904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.760054 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.760206 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.760350 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.760501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.760644 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.760786 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.760935 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.761091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.761244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.761397 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.761564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.761708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.761880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.762030 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.762172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.762315 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.762701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.762871 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.763196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.763347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.763492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.763647 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.772731 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.773446 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.773683 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.773952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.774231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.774440 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.774595 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.774749 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.774976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.775132 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.775282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.775426 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.775583 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.775741 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.775915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.776071 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.776214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.776356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.776505 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.776657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.776807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.777239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.777383 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.777533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.777683 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.777865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.778014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.778168 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.778310 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.778452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.778595 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.778746 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.778896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.779038 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.779181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.779329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.779471 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.779622 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.779772 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.779931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.780074 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.780225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.780376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.780518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.780659 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.780820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.780963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.781112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.781270 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.781425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.781567 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.781709 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.781892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.782054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.782208 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.782360 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.782503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.782654 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.782805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.782948 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.783091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.783241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.783385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.783534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.783686 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.783845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.783996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.784146 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.784297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.784441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.784597 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.784747 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.784897 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.785041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.785182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.785324 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.785477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.785627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.787774 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.787959 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.788158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.788158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.788676 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.789611 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.789782 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.789998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.790157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.790303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.790447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.790447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.790767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.790913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.791055 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.791198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.791347 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.791504 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.791662 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.791829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.791985 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.792130 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.792280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.792443 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:22:06.792595 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.792739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.792890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.793034 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.793184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.793184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.793475 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.793619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.795960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.796177 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.796332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.796497 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.796669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.796815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.796957 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.797110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.797268 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.797422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.797573 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.797717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.797892 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.798043 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.798200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.798352 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.798503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.798665 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.798819 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.798963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.799116 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.799260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.799402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.799553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.799705 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.799847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.800002 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.800147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.800289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.800442 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.800584 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.800736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.800879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.801029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.801182 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.801334 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.801477 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.801628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.801770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.802209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.802363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.802518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.802689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.802847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.802991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.803133 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.803284 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.803437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.803726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.803887 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.804031 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.804806 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.805332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.805555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.805758 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.806041 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.806255 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.806420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.806571 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.806723 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.806947 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.807099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.807247 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.807404 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.807556 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.807704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.807862 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.808021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.808189 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.808340 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.808495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.808655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.808819 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.808969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.809119 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.809277 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.809426 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.809589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.809746 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.809923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.810084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.810084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.810378 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.810536 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.810700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.810849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.810997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.811145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.811293 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.811454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.811604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.811760 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.811917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.812077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.812226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.812388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.812538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.812687 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.812837 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.812993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.813150 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.813313 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.813463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.813620 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.813771 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.813983 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.814153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.814153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.814437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.814596 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.814746 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.814896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.815063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.815221 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.815371 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.815519 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.815674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.815860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.816025 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.816188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.816344 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.816507 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.816662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.816810 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.816967 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.817125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.817282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.817440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.817589 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.817752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.817926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.818077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.818246 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.818397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.818553 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.818712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.818861 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.819010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.819159 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.819314 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.819471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.819633 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.820415 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.820666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.820865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.821017 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.821222 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.821390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.821548 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.821700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.821898 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.822055 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.822215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.822371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.822371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.822371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.822371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.822944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.823107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.823266 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.823425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.823425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.823718 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.823875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.824033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.824183 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.824332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.824489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.824646 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.824803 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.824971 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.825140 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.825791 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.825935 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826132 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826253 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826368 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826568 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826652 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826856 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.826940 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827032 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827116 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827399 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827570 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.827922 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828106 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828303 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828419 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828763 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828867 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.828953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829258 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829435 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829435 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829764 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.829968 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830135 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830221 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830408 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830499 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830584 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830676 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830956 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.830956 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831109 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831199 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831516 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831665 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831811 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831882 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.831952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832335 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832442 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832897 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.832976 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833048 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833207 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833279 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833350 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833420 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833572 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833651 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833730 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833730 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.833944 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834047 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834121 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834121 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834471 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834543 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.834690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.836649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.836746 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.836831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.836905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837102 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837191 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837372 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837535 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837705 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837891 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.837963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838291 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838373 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838601 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838682 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838682 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838823 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.838966 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839136 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839210 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839287 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839582 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839663 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839749 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.839914 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840519 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840703 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.840976 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841061 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841319 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841499 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841667 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841766 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841882 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.841978 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842074 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842219 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842289 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842359 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842436 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842659 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842659 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.842959 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843031 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843207 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843301 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843401 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843488 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843488 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843683 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843771 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.843989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844267 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844364 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844813 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.844989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845074 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845074 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845335 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845428 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.845985 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.846077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.846077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.846571 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.846679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.846805 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.846892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.846892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847062 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847426 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847519 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847599 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847776 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.847962 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848046 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848138 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848416 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848416 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848569 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848652 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848835 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.848921 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849103 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849189 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849277 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849644 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.849973 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850074 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850160 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850243 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850504 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850760 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.850972 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851228 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851307 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851494 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851574 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851807 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.851987 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852073 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852257 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852435 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852584 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.852897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.853001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.853244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.853338 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.853557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.853652 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.853909 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.854020 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.854229 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.854338 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.854542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.854644 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.854873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.854974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.855181 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.855282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.855490 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.855587 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.855804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.855905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.856113 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.856305 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.856426 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.856551 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.856740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.856836 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.857048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.857183 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.857360 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.857503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.857682 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.857885 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.858093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.858198 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.858411 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.858504 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.858726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.858827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.859037 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.859131 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.859350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.859460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.859659 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.859761 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.859983 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.860091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.860297 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.860389 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.860609 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.860715 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.860920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.861022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.861237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.861329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.861557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.861659 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.861892 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.861990 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.862212 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.862305 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.862519 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.862620 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.862838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.862931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.863146 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.863245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.863459 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.863562 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.863765 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.863865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.864079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.864178 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.864395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.864488 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.864705 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.864807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.865035 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.865129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.865352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.865506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.865663 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.865840 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.865999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.866163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.866315 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.867196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.867327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.867461 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.867580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.867677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.867779 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.867943 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.868037 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.868262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.868356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.868575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.868670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.868905 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.868997 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.869232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.869318 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.869550 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.869646 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.869881 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.869978 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.870192 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.870286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.870497 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.870590 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.870808 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.870908 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.871116 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.871210 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.871429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.871524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.871739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.871856 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.872075 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.872177 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.872389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.872491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.872701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.872793 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.873012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.873118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.873322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.873436 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.873675 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.873815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.874045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.874163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.874362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.874485 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.874672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.874768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.875000 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.875112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.875312 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.875406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.875628 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.875727 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.875941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.876034 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.876253 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.876347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.876564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.876656 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.876867 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.876969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.877209 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.877337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.877491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.877598 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.877812 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.877917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.878130 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.878226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.878454 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.878547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.878769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.878863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.879076 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.879177 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.879402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.879493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.879714 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.879828 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.880021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.880116 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.880329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.880440 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.880639 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.880732 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.880952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.881051 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.881266 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.881373 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.881579 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.881673 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.881920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.882019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.882855 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.882983 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.883169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.883294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.883510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.883621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.883829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.883924 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.884142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.884242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.884456 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.884559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.884771 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.884866 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.885078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.885172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.885386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.885492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.885697 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.885791 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.886072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.886174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.886387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.886482 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.886703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.886796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.887012 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.887104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.887322 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.887426 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.887625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.887730 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.887931 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.888060 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.888259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.888362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.888570 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.888678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.888897 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.888992 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.889211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.889314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.889520 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.889614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.889858 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.889992 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.890174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.890280 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.890510 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.890612 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.890826 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.890932 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.891168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.891270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.891495 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.891596 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.891824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.891931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.892149 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.892242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.892460 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.892555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.892776 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.892883 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.893094 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.893187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.893403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.893496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.893717 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.893832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.894055 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.894152 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.894373 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.894474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.894679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.894782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.894996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.895089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.895308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.895409 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.895626 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.895729 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.895943 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.896128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.896263 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.896562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.896825 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.896927 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.897164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.897265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.897487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.897657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.897874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.897985 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.898173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.898386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.898492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.898743 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.898838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.899081 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.899175 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.899398 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.899491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.899709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.899812 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.900026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.900122 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.900354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.900461 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.900677 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.900778 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.900991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.901091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.901322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.901431 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.901643 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.901736 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.902240 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.902350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.902563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.902676 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.902883 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.902977 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.903251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.903346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.903575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.903670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.903892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.903993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.904212 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.904306 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.904525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.904625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.904840 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.904939 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.905185 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.905286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.905461 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.905555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.905770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.905912 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.906110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.906217 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.906423 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.906525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.906736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.906831 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.907054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.907161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.907366 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.907459 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.907678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.907781 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.907987 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.908097 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.908319 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.908421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.908629 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.908725 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.908941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.909113 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.909260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.909363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.909587 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.909781 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.909954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.910126 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.910222 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.910467 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.910569 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.910800 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.910943 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.911131 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.911225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.911444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.911545 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.911757 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.911860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.912084 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.912185 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.912398 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.912500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.912709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.912861 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.913026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.913128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.913345 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.913512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.913681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.913875 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.914035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.914132 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.914351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.914445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.914665 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.914769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.914984 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.915085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.915296 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.915389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.915610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.915868 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.915971 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.916191 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.916293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.916511 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.916621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.916819 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.916919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.917130 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.917227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.917444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.917547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.917757 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.917897 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.918116 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.918213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.918425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.918518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.918737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.918840 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.919054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.919146 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.919366 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.919468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.919679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.919774 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.919986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.920077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.920298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.920398 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.920607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.920709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.920912 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.921014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.921228 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.921329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.921537 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.921631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.921895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.922008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.922209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.922304 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.922521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.922623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.922831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.922936 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.923153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.923248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.923465 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.923566 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.923776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.923884 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.924087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.924190 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.924397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.924491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.924712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.924815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.925020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.925114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.925332 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.925433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.925642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.925743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.925991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.926088 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.926301 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.926394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.926616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.926718 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.926971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.927154 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.927302 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.927491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.927595 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.927850 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.927957 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.928136 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.928287 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.928453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.928548 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.928773 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.928867 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.929623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.929777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.930018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.930148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.930319 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.930448 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.930641 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.930763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.931082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.931222 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.931415 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.931518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.931748 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.931856 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.932082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.932177 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.932425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.932528 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.932741 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.932844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.933053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.933156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.933367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.933470 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.933685 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.933787 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.934046 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.934154 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.934363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.934459 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.934680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.934775 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.934997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.935099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.935315 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.935416 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.935626 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.935727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.935941 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.936034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.936251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.936344 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.936565 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.936657 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.936873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.936973 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.937186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.937331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.937497 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.937594 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.937849 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.937970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.938148 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.938302 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.938476 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.938574 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.938796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.938897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.939118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.939292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.939433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.939534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.939750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.939851 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.940065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.940167 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.940379 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.940590 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.940685 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.940919 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.941022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.941264 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.941358 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.941601 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.941704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.941956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.942070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.942268 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.942394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.942729 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.942836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.943068 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.943164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.943386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.943489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.943703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.943805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.944014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.944108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.944327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.944420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.944661 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.945306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.945636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.945739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.946082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.946177 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.946405 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.946499 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.946737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.946833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.947059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.947154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.947403 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.947607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.947737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.947971 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.948106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.948304 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.948444 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.948640 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.948742 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.948949 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.949053 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.949270 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.949373 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.949584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.949680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.949920 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.950030 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.950231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.950334 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.950543 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.950637 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.950851 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.950945 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.951160 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.951263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.951469 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.951562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.951778 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.951877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.952084 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.952187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.952391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.952485 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.952701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.952800 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.953005 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.953108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.953312 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.953413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.953619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.953713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954003 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954665 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.954972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.955180 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.955282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.955488 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.955582 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.955798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.955892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.956113 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.956214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.956429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.956524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.956743 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.956838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.957060 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.957155 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.957373 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.957512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.957692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.957863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.958029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.958159 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.958348 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.958526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.958674 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.958812 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.958995 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.959098 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.959307 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.959415 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.959616 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.959710 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.959938 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.960032 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.960249 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.960376 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.960602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.960701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.960912 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.961013 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.961227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.961331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.961544 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.961663 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.961903 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.962019 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.962240 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.962682 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.962799 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.962886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.962960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.963181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.963294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.963506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.963609 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.963831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.963925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.964148 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.964250 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.964464 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.964558 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.964779 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.964872 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.965094 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.965189 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.965410 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.965510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.965722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.965830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.966065 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.966169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.966385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.966487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.966701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.966802 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.967014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.967115 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.967331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.967425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.967648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.967749 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.967961 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.968054 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.968395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.968620 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.968748 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.968877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969001 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969097 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969668 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969861 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.969962 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.970192 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.970286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.970499 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.970602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.970745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118092) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:22:06.970847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.971135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.971454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.971769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.972084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.972400 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.972720 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.973061 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.973382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.973692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.974241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.974565 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.974890 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.975218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.975536 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.975866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.976907 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.977235 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.977567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.977920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.978256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.978606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.978945 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.979282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.979597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.979909 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.980221 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.980537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.980860 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.981174 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.981484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.981796 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.982128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.982437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.982745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.983055 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.983367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.983680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.983991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.984301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.984612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.984922 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.985231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.985538 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.985874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.986188 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.986498 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.986807 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.987117 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.987428 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.987764 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.988102 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.988425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.988759 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.989078 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.989406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.989718 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.990079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.990406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.990728 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.991042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.991377 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.991750 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.992066 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.992478 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.992795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.993111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.993433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.993763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.994118 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.994435 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.994767 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.995095 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.995421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.995742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.996059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.996395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.996710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.997125 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.997453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.997772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.998113 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.998438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.998759 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.999094 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.999439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:06.999744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.000076 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.000407 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.000759 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.001078 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.001429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.001762 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.002111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.002431 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.002742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:22:07.002989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:22:07.035271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO dbcounter [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Registered counter for database nova_api Jun 20 12:22:07.055919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_db.sqlalchemy.engines [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.062750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writer thread running {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.067726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO dbcounter [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Registered counter for database nova_api Jun 20 12:22:07.089440 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_db.sqlalchemy.engines [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.096156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writer thread running {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.120420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.context [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1005ee0f-ec24-457d-9b36-b8a9b0504dd6(cell1) {{(pid=118092) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 12:22:07.124553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.126163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.126979 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.128937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.130963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO dbcounter [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Registered counter for database nova_cell0 Jun 20 12:22:07.135679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO dbcounter [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Registered counter for database nova_cell1 Jun 20 12:22:07.143027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_db.sqlalchemy.engines [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.144742 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_db.sqlalchemy.engines [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.150734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writer thread running {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.153608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.context [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1005ee0f-ec24-457d-9b36-b8a9b0504dd6(cell1) {{(pid=118091) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 12:22:07.157744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.159359 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.160177 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:22:07.162159 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:22:07.164192 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO dbcounter [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Registered counter for database nova_cell0 Jun 20 12:22:07.168242 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO dbcounter [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Registered counter for database nova_cell1 Jun 20 12:22:07.175180 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_db.sqlalchemy.engines [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.177486 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_db.sqlalchemy.engines [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.182675 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writer thread running {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.188024 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writer thread running {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.295096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writer thread running {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.305321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO dbcounter [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Registered counter for database nova_cell0 Jun 20 12:22:07.311941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_db.sqlalchemy.engines [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118092) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.316486 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writer thread running {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.339590 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO dbcounter [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Registered counter for database nova_cell0 Jun 20 12:22:07.346496 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_db.sqlalchemy.engines [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:22:07.350783 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writer thread running {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:22:07.641705 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: WARNING keystonemiddleware.auth_token [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:22:07.649394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: WARNING keystonemiddleware.auth_token [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:22:07.675055 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: WARNING keystonemiddleware.auth_token [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:22:07.683183 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: WARNING keystonemiddleware.auth_token [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:22:07.997334 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: WARNING keystonemiddleware.auth_token [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:22:08.003922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: WARNING keystonemiddleware.auth_token [None req-21e026b3-60bf-44fd-9eb2-eb2e257bb7f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:22:08.010258 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563da01469c0 pid: 118092 (default app) Jun 20 12:22:08.031612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: WARNING keystonemiddleware.auth_token [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 12:22:08.037789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: WARNING keystonemiddleware.auth_token [None req-5055acaf-adc5-4178-a397-9b8386e99271 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 12:22:08.043355 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563da01469c0 pid: 118091 (default app) Jun 20 12:22:48.634034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.634825 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.636193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.637163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:50.001423 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6e6dca78-4b1f-4722-b3ba-34e0ac4790d3 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Action: 'create', calling method: .version_select at 0x7fe292972790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1957323358"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:52.362208 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6e6dca78-4b1f-4722-b3ba-34e0ac4790d3 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.743161 Jun 20 12:22:52.371096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1154 bytes} [Mon Jun 20 12:22:48 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3754 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 12:22:52.744317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9feb48e2-7aa1-4e66-87cf-5098dff7fb8c tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe292a27280>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:52.778348 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:52.779695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:52.781071 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:52.782120 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:53.475488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9feb48e2-7aa1-4e66-87cf-5098dff7fb8c tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 200 len: 346 microversion: 2.1 time: 1.102328 Jun 20 12:22:53.480347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 1/2] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:22:52 2022] GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 346 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:22:53.489486 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2db23cef-bd4a-4b59-aa78-2ba2510a9278 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Action: 'create', calling method: .version_select at 0x7fe29283e550>, body: {"snapshot": {"volume_id": "df41a076-22b2-43c7-894d-86f4239b61dd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2141397281"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:22:54.489054 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2db23cef-bd4a-4b59-aa78-2ba2510a9278 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.004660 Jun 20 12:22:54.495941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 2/3] 10.222.0.64 () {60 vars in 1161 bytes} [Mon Jun 20 12:22:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:54.519443 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f6568372-edf2-40d7-af03-038771884fbc tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29287e670>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:55.603087 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f6568372-edf2-40d7-af03-038771884fbc tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16" status: 200 len: 287 microversion: 2.1 time: 1.101941 Jun 20 12:22:55.604039 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 20 12:22:54 2022] GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 => generated 287 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:55.614047 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b0b4454c-1766-4995-bf7a-1d02a66b7dd9 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29283e5e0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:55.923237 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b0b4454c-1766-4995-bf7a-1d02a66b7dd9 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.313196 Jun 20 12:22:55.924953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1139 bytes} [Mon Jun 20 12:22:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:55.937598 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-02c2d07f-ba89-44e5-bb23-556314fd70df tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29287e8b0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:56.004080 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-02c2d07f-ba89-44e5-bb23-556314fd70df tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16" status: 200 len: 287 microversion: 2.1 time: 0.071256 Jun 20 12:22:56.004923 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 20 12:22:55 2022] GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:57.024557 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-543403ad-7a32-4a81-9ce1-0e67e6a5a0e9 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe292854310>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:57.193298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-543403ad-7a32-4a81-9ce1-0e67e6a5a0e9 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16" status: 200 len: 287 microversion: 2.1 time: 0.173506 Jun 20 12:22:57.194342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 20 12:22:57 2022] GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 => generated 287 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:58.205540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-07bf5381-e67c-413a-a965-d9bc644e5c97 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29287edc0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:58.311520 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-07bf5381-e67c-413a-a965-d9bc644e5c97 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16" status: 200 len: 288 microversion: 2.1 time: 0.101656 Jun 20 12:22:58.311520 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 20 12:22:58 2022] GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 => generated 288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:58.325834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-690ff4f4-86dc-4405-a834-3ec409aba4ac tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe292854a60>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:58.538799 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-690ff4f4-86dc-4405-a834-3ec409aba4ac tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16" status: 202 len: 0 microversion: 2.1 time: 0.218004 Jun 20 12:22:58.539630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 5/9] 10.222.0.64 () {58 vars in 1253 bytes} [Mon Jun 20 12:22:58 2022] DELETE /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:22:58.550248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-36fe24f7-6781-4f39-8fcc-0548e5e0e24d tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe2928474c0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:58.613082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-36fe24f7-6781-4f39-8fcc-0548e5e0e24d tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16" status: 200 len: 287 microversion: 2.1 time: 0.068366 Jun 20 12:22:58.614572 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 20 12:22:58 2022] GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:22:59.627532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5ae4fa70-af85-4140-bef9-08c43a19bb18 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29283e4c0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:22:59.674677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-5ae4fa70-af85-4140-bef9-08c43a19bb18 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] HTTP exception thrown: Snapshot 9e5d32ae-0a72-4f22-9832-8d16c92b9b16 could not be found. Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5ae4fa70-af85-4140-bef9-08c43a19bb18 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Request method failure captured: Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 HTTP/1.1 Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGaYfhXZv74r0TSbNW3xS9-JSavNJOqisg4dn-zeMboNOTjsrno-N6pFpE6jyC0ANA_F5Qispusue7bIZy5AgTdpN8a6lqscaFTUh9rCh2DslK-K46vawINpSVRS_kTMauOZSEk4OYR1qr8pahjDiLH_ypWs9hXxwBbmsd74iwoT5Aw Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:22:59.679197 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}] Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 6988a4385f3746cab807e36d5c515013 Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Snapshot 9e5d32ae-0a72-4f22-9832-8d16c92b9b16 could not be found. Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '9e5d32ae-0a72-4f22-9832-8d16c92b9b16'} Jun 20 12:22:59.680573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9e5d32ae-0a72-4f22-9832-8d16c92b9b16 could not be found. (HTTP 404) (Request-ID: req-9af9ed74-6d99-48ba-9e1c-d78f593a8607) Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:22:59.684491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:22:59.685565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9e5d32ae-0a72-4f22-9832-8d16c92b9b16 could not be found. Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 12:22:59.686830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9e5d32ae-0a72-4f22-9832-8d16c92b9b16 could not be found. Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9e5d32ae-0a72-4f22-9832-8d16c92b9b16 could not be found. Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5ae4fa70-af85-4140-bef9-08c43a19bb18 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Returning 404 to user: Snapshot 9e5d32ae-0a72-4f22-9832-8d16c92b9b16 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:22:59.687884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5ae4fa70-af85-4140-bef9-08c43a19bb18 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16" status: 404 len: 111 microversion: 2.1 time: 0.057349 Jun 20 12:22:59.688742 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 20 12:22:59 2022] GET /compute/v2.1/os-snapshots/9e5d32ae-0a72-4f22-9832-8d16c92b9b16 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:22:59.695293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f3c09112-3dfb-4d1d-bdd4-0c459888ef94 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29287eca0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:00.040180 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f3c09112-3dfb-4d1d-bdd4-0c459888ef94 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 202 len: 0 microversion: 2.1 time: 0.349966 Jun 20 12:23:00.053623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:22:59 2022] DELETE /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:23:00.059200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9a67cadd-8101-43c0-b4cb-470ad9983e3e tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe2931a0b80>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:00.182950 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9a67cadd-8101-43c0-b4cb-470ad9983e3e tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 200 len: 345 microversion: 2.1 time: 0.128397 Jun 20 12:23:00.183801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:00 2022] GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:01.200310 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d8dc5f69-3945-4675-8b86-e9b04dee3dd1 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29287e310>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:01.306753 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d8dc5f69-3945-4675-8b86-e9b04dee3dd1 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 200 len: 345 microversion: 2.1 time: 0.114963 Jun 20 12:23:01.307323 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 7/14] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:01 2022] GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:02.319932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f04245f4-f5ba-43c3-a544-ae85713e2616 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29283ef70>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:02.413555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f04245f4-f5ba-43c3-a544-ae85713e2616 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 200 len: 345 microversion: 2.1 time: 0.097384 Jun 20 12:23:02.414415 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:02 2022] GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:03.428067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f0353771-5eaa-460b-b0e2-bf64ebb57e02 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe2928534c0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:03.452871 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e120f686-8bfc-49dd-931e-97143493e80d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'create', calling method: .version_select at 0x7fe2928475e0>, body: {"keypair": {"name": "tempest-keypair-891217855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+FT19r01g22ZkX+i8Lzb9vaqsaFN6ses/7jGcxQ4aZ4KDiGiaWQSIh3dPnOJ5CcO+KyKdsVbcxeltoCQq1VNtdiYOSVFiQHP/pyTft8ReEtBTw2QQ0v7A88eDi1s1F6w=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:03.512157 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-f0353771-5eaa-460b-b0e2-bf64ebb57e02 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] HTTP exception thrown: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f0353771-5eaa-460b-b0e2-bf64ebb57e02 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Request method failure captured: Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd HTTP/1.1 Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGaYfhXZv74r0TSbNW3xS9-JSavNJOqisg4dn-zeMboNOTjsrno-N6pFpE6jyC0ANA_F5Qispusue7bIZy5AgTdpN8a6lqscaFTUh9rCh2DslK-K46vawINpSVRS_kTMauOZSEk4OYR1qr8pahjDiLH_ypWs9hXxwBbmsd74iwoT5Aw Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:23:03.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}] Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 6988a4385f3746cab807e36d5c515013 Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'df41a076-22b2-43c7-894d-86f4239b61dd'} Jun 20 12:23:03.517540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. (HTTP 404) (Request-ID: req-5780d075-41a0-4243-aba7-f7e21d72d99d) Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.518306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:23:03.519331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:23:03.520271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.521246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.523752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f0353771-5eaa-460b-b0e2-bf64ebb57e02 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Returning 404 to user: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:23:03.525286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f0353771-5eaa-460b-b0e2-bf64ebb57e02 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 404 len: 109 microversion: 2.1 time: 0.102403 Jun 20 12:23:03.526077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 9/16] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:03 2022] GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:23:03.552503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-33b86c74-aa49-4aa0-9f3f-53889ff20916 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29283e550>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:03.555601 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-e120f686-8bfc-49dd-931e-97143493e80d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:03.575581 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-e120f686-8bfc-49dd-931e-97143493e80d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for user 41eb98b3a8434e7e9734eb747047a87d and project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:03.619019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-33b86c74-aa49-4aa0-9f3f-53889ff20916 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] HTTP exception thrown: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-33b86c74-aa49-4aa0-9f3f-53889ff20916 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Request method failure captured: Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd HTTP/1.1 Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGaYfhXZv74r0TSbNW3xS9-JSavNJOqisg4dn-zeMboNOTjsrno-N6pFpE6jyC0ANA_F5Qispusue7bIZy5AgTdpN8a6lqscaFTUh9rCh2DslK-K46vawINpSVRS_kTMauOZSEk4OYR1qr8pahjDiLH_ypWs9hXxwBbmsd74iwoT5Aw Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:23:03.621118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}] Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 6988a4385f3746cab807e36d5c515013 Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'df41a076-22b2-43c7-894d-86f4239b61dd'} Jun 20 12:23:03.622449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. (HTTP 404) (Request-ID: req-95ea552f-320a-477c-baf8-75c873f0d72d) Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.623185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:23:03.624297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 12:23:03.626616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-33b86c74-aa49-4aa0-9f3f-53889ff20916 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Returning 404 to user: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:23:03.628648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-33b86c74-aa49-4aa0-9f3f-53889ff20916 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 404 len: 109 microversion: 2.1 time: 0.095501 Jun 20 12:23:03.630860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 10/17] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:23:03 2022] DELETE /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:23:03.643833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f2d177df-dd78-4f83-b1c6-221244d1b245 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Calling method '.version_select at 0x7fe29283eaf0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:03.726885 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-f2d177df-dd78-4f83-b1c6-221244d1b245 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] HTTP exception thrown: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f2d177df-dd78-4f83-b1c6-221244d1b245 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Request method failure captured: Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd HTTP/1.1 Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGaYfhXZv74r0TSbNW3xS9-JSavNJOqisg4dn-zeMboNOTjsrno-N6pFpE6jyC0ANA_F5Qispusue7bIZy5AgTdpN8a6lqscaFTUh9rCh2DslK-K46vawINpSVRS_kTMauOZSEk4OYR1qr8pahjDiLH_ypWs9hXxwBbmsd74iwoT5Aw Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:23:03.729136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/644e467d3892497a92a4c23fa12f6c03"}]}] Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 644e467d3892497a92a4c23fa12f6c03 Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1999424963 Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 6988a4385f3746cab807e36d5c515013 Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1999424963-project Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'df41a076-22b2-43c7-894d-86f4239b61dd'} Jun 20 12:23:03.730251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. (HTTP 404) (Request-ID: req-3364146a-cbbf-4464-874c-1a90b7aa7a5c) Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.731006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:23:03.731917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:23:03.732804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. Jun 20 12:23:03.733702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:23:03.736145 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f2d177df-dd78-4f83-b1c6-221244d1b245 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] Returning 404 to user: Volume df41a076-22b2-43c7-894d-86f4239b61dd could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:23:03.737207 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f2d177df-dd78-4f83-b1c6-221244d1b245 tempest-VolumesSnapshotsTestJSON-1999424963 tempest-VolumesSnapshotsTestJSON-1999424963-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd" status: 404 len: 109 microversion: 2.1 time: 0.102255 Jun 20 12:23:03.738359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 11/18] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:03 2022] GET /compute/v2.1/os-volumes/df41a076-22b2-43c7-894d-86f4239b61dd => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:23:03.858390 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e120f686-8bfc-49dd-931e-97143493e80d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.151544 Jun 20 12:23:03.860940 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 8/19] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:23:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:05.894784 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-617019844", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "networks": [{"uuid": "13275a84-9c65-4672-bb22-e371a429d23c"}]}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:06.238977 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] validate_networks() for [('13275a84-9c65-4672-bb22-e371a429d23c', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:08.985075 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:08.985660 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:08.986164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:08.986762 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:08.987163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:09.023680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:09.027982 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:09.028907 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:09.029487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:09.068068 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Getting quotas for project a3499b45946141ff9177a6f3bbf01d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:09.082319 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Getting quotas for user 03102ea04c0e42b19576f1800f8cc6e9 and project a3499b45946141ff9177a6f3bbf01d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:09.098590 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:09.103610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:09.308524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f5455100-faa5-481e-8964-175ec5f17e95 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.869487 Jun 20 12:23:09.310486 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 12/20] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:23:09.342174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-39815e9c-5c2d-42f6-aae7-200b5c01b38f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:09.345551 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-39815e9c-5c2d-42f6-aae7-200b5c01b38f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:09.537326 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-39815e9c-5c2d-42f6-aae7-200b5c01b38f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:09.555182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-39815e9c-5c2d-42f6-aae7-200b5c01b38f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1214 microversion: 2.1 time: 0.228953 Jun 20 12:23:09.556445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 13/21] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:09 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:09.660571 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5f803d2c-9953-40b1-9ef7-d4fcf09c2321 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: .version_select at 0x7fe2927a3280>, body: {"keypair": {"name": "tempest-keypair-494182752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7qI9/lSu33usuoHcnHU893b9R80+/NqdYkHrUXxtO/L45juDcsJ/b7RQo6CHS1Qlz1B3S7XzsIPoOMoE9lxKFw5SbonLBPzWw1lElGKgOylqD49GQOjtloU0D9fX5iUA=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:09.685302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-5f803d2c-9953-40b1-9ef7-d4fcf09c2321 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:09.690397 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-5f803d2c-9953-40b1-9ef7-d4fcf09c2321 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:09.807925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5f803d2c-9953-40b1-9ef7-d4fcf09c2321 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.930907 Jun 20 12:23:09.808815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 9/22] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:23:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:10.081327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1963544780", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:10.203944 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] validate_networks() for [('bb2cad9e-caeb-44ad-af38-7ce84a4c3771', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:10.574838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f6172b9b-8536-43bf-b88d-c90bc0721269 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:10.575738 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f6172b9b-8536-43bf-b88d-c90bc0721269 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:10.871733 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f6172b9b-8536-43bf-b88d-c90bc0721269 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:10.919378 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f6172b9b-8536-43bf-b88d-c90bc0721269 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1214 microversion: 2.1 time: 0.348296 Jun 20 12:23:10.920067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 10/23] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:10 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:11.845708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:11.846983 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:11.847691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:11.848116 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:11.848585 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:11.859801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:11.861129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:11.862455 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:11.863119 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:11.892794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:11.898188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for user ec4c5293e6a148a2a16ba4c3fc57a3a3 and project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:11.913969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:11.917242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:11.938122 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-45dfbc95-978e-4c42-8b39-e73e2f2be318 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:11.938858 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-45dfbc95-978e-4c42-8b39-e73e2f2be318 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:12.062742 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8bfbff83-56bc-47b1-814c-fd30b5ca978b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.318100 Jun 20 12:23:12.072773 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 14/24] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:23:12.103402 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c759ef8c-7add-4370-ab2f-3179591d17f9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:12.104044 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c759ef8c-7add-4370-ab2f-3179591d17f9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:12.140151 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-45dfbc95-978e-4c42-8b39-e73e2f2be318 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:12.148140 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-45dfbc95-978e-4c42-8b39-e73e2f2be318 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1214 microversion: 2.1 time: 0.214364 Jun 20 12:23:12.154135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 11/25] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:11 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:12.161450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-597370918", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cb023b5-9bac-4dc4-978f-aa570457c65c"}], "security_groups": [{"name": "tempest-securitygroup--1235914904"}], "key_name": "tempest-keypair-891217855", "user_data": "}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:12.226130 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c759ef8c-7add-4370-ab2f-3179591d17f9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:12.231726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c759ef8c-7add-4370-ab2f-3179591d17f9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1222 microversion: 2.1 time: 0.152311 Jun 20 12:23:12.232897 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 15/26] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:12 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:12.489029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] validate_networks() for [('3cb023b5-9bac-4dc4-978f-aa570457c65c', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:12.831743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1049598794", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:12.953548 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] validate_networks() for [('bb2cad9e-caeb-44ad-af38-7ce84a4c3771', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:14.130405 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:14.131420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:14.131420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:14.131886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:14.132239 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:14.173244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.174044 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.175034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.175631 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.215278 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:14.224160 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for user ec4c5293e6a148a2a16ba4c3fc57a3a3 and project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:14.263853 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:14.267399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:14.507893 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3a3c0481-23a9-4182-8ae8-65acf3c3e87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.677813 Jun 20 12:23:14.509211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 16/27] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:23:14.515695 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:14.516633 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:14.541271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.542512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.543702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.544343 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.777481 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:14.778700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:14.779352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:14.779932 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:14.780494 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:14.822104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.823439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.825009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:14.825456 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:14.979737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:14.998515 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for user 41eb98b3a8434e7e9734eb747047a87d and project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:15.071337 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:15.088179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:15.433355 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-584da52c-4fb4-4469-ac14-cdc5154f895e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.277797 Jun 20 12:23:15.434139 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 12/28] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:23:15.442052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5decc8a9-d2e7-4e34-bc3f-80e869549c4e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:15.444386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5decc8a9-d2e7-4e34-bc3f-80e869549c4e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:15.634240 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5decc8a9-d2e7-4e34-bc3f-80e869549c4e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:15.655442 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5decc8a9-d2e7-4e34-bc3f-80e869549c4e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1222 microversion: 2.1 time: 0.220055 Jun 20 12:23:15.656038 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 13/29] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:15 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:15.673796 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-fc33491b-42ca-4841-aae9-82d098c78c75 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:15.676112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-fc33491b-42ca-4841-aae9-82d098c78c75 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:15.841247 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:15.855528 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-fc33491b-42ca-4841-aae9-82d098c78c75 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:15.862936 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-fc33491b-42ca-4841-aae9-82d098c78c75 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1236 microversion: 2.1 time: 0.199682 Jun 20 12:23:15.876009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 14/30] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:15 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1236 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:15.880253 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-19276240-a3da-41be-9955-b6fdb2b560b3 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1274 microversion: 2.1 time: 1.369277 Jun 20 12:23:15.891245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 17/31] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:14 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1274 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:16.363605 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4224a738-7be5-4cb0-9eda-ee43f754d714 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe291ebbd30>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:16.475679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4224a738-7be5-4cb0-9eda-ee43f754d714 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e56f6baf-9dcf-4dbf-a756-354a337f93ce" status: 200 len: 351 microversion: 2.1 time: 0.116366 Jun 20 12:23:16.476261 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 15/32] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:16 2022] GET /compute/v2.1/os-volumes/e56f6baf-9dcf-4dbf-a756-354a337f93ce => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:16.672563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:16.673474 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:16.680024 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:16.680487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:16.681283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:16.681729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:16.893424 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d1d5e9da-295f-42ff-af32-68d302a36e0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:16.894572 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d1d5e9da-295f-42ff-af32-68d302a36e0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:17.015646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:17.029308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-dac04332-bd38-4351-af1f-66b31ec44dc6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1226 microversion: 2.1 time: 0.360578 Jun 20 12:23:17.034980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 18/33] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:16 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1226 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:17.054440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:17.057457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:17.089079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d1d5e9da-295f-42ff-af32-68d302a36e0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:17.096254 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:17.096721 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:17.097609 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:17.110028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d1d5e9da-295f-42ff-af32-68d302a36e0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1236 microversion: 2.1 time: 0.220800 Jun 20 12:23:17.110731 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 16/34] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:16 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1236 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:17.112614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:17.424877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:17.436096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1d6a742c-2f4b-4fea-8a40-a68926381b18 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1272 microversion: 2.1 time: 0.397465 Jun 20 12:23:17.440504 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 19/35] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:17 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:17.709395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-790413461", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ad919b-444d-4364-9171-7dcb6a499f3f"}], "security_groups": [{"name": "tempest-securitygroup--2079070973"}], "key_name": "tempest-keypair-494182752", "user_data": "}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:17.938178 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] validate_networks() for [('25ad919b-444d-4364-9171-7dcb6a499f3f', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:18.059391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:18.060649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:18.459901 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.459901 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.459901 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.459901 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.462367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:18.462367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-554d4af4-f045-4726-84b0-9ebe3f510c06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1274 microversion: 2.1 time: 0.235838 Jun 20 12:23:18.462367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 20/36] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:18 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:18.462367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:18.463839 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:18.463839 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.463839 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.463839 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.464503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.519538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:18.532998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ea49c99a-85b2-4847-8e68-380130504fd8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1232 microversion: 2.1 time: 0.246054 Jun 20 12:23:18.533657 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 21/37] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:18 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1232 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:18.546863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:18.547531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:18.556152 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.556633 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:18.558304 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:18.558751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.224680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:19.237518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7de03933-bccf-4e4b-9214-6c610d63dc3f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.697496 Jun 20 12:23:19.250531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 22/38] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:18 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:19.292196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:19.294067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:19.295188 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:19.295612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:19.296220 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:19.308768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.309555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:19.312092 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.314899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.316165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.316717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.318647 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.323468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.323468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.323468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.368202 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:19.382004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:19.434559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:19.436877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:19.548072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:19.562516 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3d4bb95d-4629-4faa-9779-a02e587b509e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1292 microversion: 2.1 time: 0.257823 Jun 20 12:23:19.571452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 23/39] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1292 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:19.591505 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a4e507ba-16db-4676-973c-dad24f7d1e46 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe2915f25e0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.757716 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-dcdbb817-0d47-4bd1-9d27-10d57acc40b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.048019 Jun 20 12:23:19.768816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 17/40] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:23:19.799163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.799606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:19.875816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.876205 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.876996 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:19.877433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:19.938730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a4e507ba-16db-4676-973c-dad24f7d1e46 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ef0049aa-4e81-45d7-a9c2-9eca56609059" status: 200 len: 351 microversion: 2.1 time: 0.365041 Jun 20 12:23:19.942726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 24/41] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/os-volumes/ef0049aa-4e81-45d7-a9c2-9eca56609059 => generated 351 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:19.989712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-87bf1327-8e8f-4fd5-9118-5f6dd4ce29b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:19.989712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-87bf1327-8e8f-4fd5-9118-5f6dd4ce29b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:20.501021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-87bf1327-8e8f-4fd5-9118-5f6dd4ce29b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:20.516073 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-87bf1327-8e8f-4fd5-9118-5f6dd4ce29b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1240 microversion: 2.1 time: 0.568053 Jun 20 12:23:20.517086 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 25/42] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1240 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:20.540401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:20.544498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:20.580929 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.581381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:20.583316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.584923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:20.808111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:20.830516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-56144c81-67d3-455f-b9c2-90f044df6cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1296 microversion: 2.1 time: 1.057621 Jun 20 12:23:20.831592 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 18/43] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:19 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1296 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:20.837474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:20.838256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:20.845045 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.845584 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:20.846732 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:20.847281 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.022671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:21.034099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4b21b6a7-c465-481b-b63a-3cdf3443e953 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1280 microversion: 2.1 time: 0.199933 Jun 20 12:23:21.035388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 19/44] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:20 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:21.540804 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:21.540804 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:21.576740 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.577313 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.578214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.581532 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.710115 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:21.724444 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:21.725853 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cf86311d-719e-4695-b9a5-a4199691e194 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1244 microversion: 2.1 time: 0.193038 Jun 20 12:23:21.727741 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 20/45] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:21 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1244 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:21.742218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-01134ae6-c51e-4703-b174-bfedb9af1ed8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 1.223257 Jun 20 12:23:21.753498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 26/46] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:20 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:21.850279 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:21.851616 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:21.868169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.870010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:21.870010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:21.870010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:22.054530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:22.055069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:22.063467 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:22.063924 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:22.064696 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:22.065264 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:22.393303 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:22.422540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-89d12845-5ba9-43f9-a268-f4e5296f7b3d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1294 microversion: 2.1 time: 0.576859 Jun 20 12:23:22.425233 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 21/47] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:21 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1294 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:22.452218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-373b8d47-70f7-4684-a4c0-399d0586e1a6 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe290dfeaf0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:22.617028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-373b8d47-70f7-4684-a4c0-399d0586e1a6 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/b7ea035c-2d91-4472-baca-d6e9bc823cb3" status: 200 len: 350 microversion: 2.1 time: 0.171579 Jun 20 12:23:22.617606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:23:22 2022] GET /compute/v2.1/os-volumes/b7ea035c-2d91-4472-baca-d6e9bc823cb3 => generated 350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:22.837570 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:22.857346 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3fc3db39-3444-450c-a2d4-807d45ce408a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1280 microversion: 2.1 time: 0.807130 Jun 20 12:23:22.873352 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 27/49] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:22 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1280 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:22.884341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b8f0f83a-7c8c-4fc5-8b1a-b727def8bfef tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe2915b1a60>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:22.947145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-3af1a034-54ec-44d4-a8f0-ca672c3516e0 req-cd747a57-29dd-4fce-b9cc-ee6187818f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108e8e51-7234-4ddc-9ff6-6e2bfed530ff", "tag": "ec887b68-8427-4b8e-94d0-cd7c4c5dd881"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:22.964327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-3af1a034-54ec-44d4-a8f0-ca672c3516e0 req-cd747a57-29dd-4fce-b9cc-ee6187818f01 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:22.965131 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-3af1a034-54ec-44d4-a8f0-ca672c3516e0 req-cd747a57-29dd-4fce-b9cc-ee6187818f01 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.023044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-3af1a034-54ec-44d4-a8f0-ca672c3516e0 req-cd747a57-29dd-4fce-b9cc-ee6187818f01 service nova] Creating event network-changed:ec887b68-8427-4b8e-94d0-cd7c4c5dd881 for instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff on hv-cinder-83697 Jun 20 12:23:23.023967 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-3af1a034-54ec-44d4-a8f0-ca672c3516e0 req-cd747a57-29dd-4fce-b9cc-ee6187818f01 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118091) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:23:23.033697 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b54445c2-097b-4d57-9478-e8e85ccdedf7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.034781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b54445c2-097b-4d57-9478-e8e85ccdedf7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.036485 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b54445c2-097b-4d57-9478-e8e85ccdedf7 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.037210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b54445c2-097b-4d57-9478-e8e85ccdedf7 None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.084466 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.compute.rpcapi [None req-b54445c2-097b-4d57-9478-e8e85ccdedf7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 12:23:23.093286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b54445c2-097b-4d57-9478-e8e85ccdedf7 None None] Releasing lock "compute-rpcapi-router" {{(pid=118091) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:23:23.135455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b54445c2-097b-4d57-9478-e8e85ccdedf7 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516540 Jun 20 12:23:23.137867 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 23/50] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:23.149487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:23.150556 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:23.159609 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b8f0f83a-7c8c-4fc5-8b1a-b727def8bfef tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.282690 Jun 20 12:23:23.162988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.163325 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 28/51] 10.222.0.64 () {58 vars in 1133 bytes} [Mon Jun 20 12:23:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:23.172084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.174287 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.174948 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.177576 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:23.178954 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:23.221900 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.224744 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.232937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.234301 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.766943 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:23.767816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:23.777122 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-bc7f6c20-503e-4aea-8d37-b9580fbc4168 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1292 microversion: 2.1 time: 0.639413 Jun 20 12:23:23.777717 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 24/52] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:23 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1292 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:23.799067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-afc49293-5b0a-4132-aa6b-81a352c42f16 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe290dfe820>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:23.800035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-33d82793-cd62-44ce-9d43-d150eaf2d270 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.630958 Jun 20 12:23:23.813401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 29/53] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:23 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:23.820836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:23.822131 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:23.858342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.861794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:23.865354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:23.870859 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.062728 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-afc49293-5b0a-4132-aa6b-81a352c42f16 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.283811 Jun 20 12:23:24.064254 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 25/54] 10.222.0.64 () {58 vars in 1148 bytes} [Mon Jun 20 12:23:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:24.084537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:24.087744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:24.108221 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.109298 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.110468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.111091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.187651 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=6 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:24.509666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:24.538877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-83ab65c5-5faf-4a63-911b-175ac27bb4fd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1294 microversion: 2.1 time: 0.719842 Jun 20 12:23:24.545454 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 30/55] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:23 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1294 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:24.557975 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f2e25f58-946b-4cac-a158-f4fa4d578eba tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe2915b1550>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:24.617145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:24.625688 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-21834d89-dcdc-42e0-bb37-644297d94e50 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.560076 Jun 20 12:23:24.630005 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 26/56] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:24 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:24.715859 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f2e25f58-946b-4cac-a158-f4fa4d578eba tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.167861 Jun 20 12:23:24.716785 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 31/57] 10.222.0.64 () {58 vars in 1133 bytes} [Mon Jun 20 12:23:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:24.728410 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f19e4605-eef3-4e20-864f-8280d638ceed tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe2915d1af0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:24.929373 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f19e4605-eef3-4e20-864f-8280d638ceed tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.205338 Jun 20 12:23:24.939623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 32/58] 10.222.0.64 () {58 vars in 1166 bytes} [Mon Jun 20 12:23:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:24.946396 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:24.947171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:24.967764 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.968476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.972150 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:24.973916 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:24.983476 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-c2147b73-179c-40c9-88b5-39529b29cbc8 req-48ceaf4c-d899-48e2-a41c-f1751168e11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2c0d3f-5fbd-486e-98fa-9056dde04005", "tag": "c053b7b1-6ef3-43e4-9697-4f9502b323cb"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:25.001419 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-c2147b73-179c-40c9-88b5-39529b29cbc8 req-48ceaf4c-d899-48e2-a41c-f1751168e11b service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.003744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-c2147b73-179c-40c9-88b5-39529b29cbc8 req-48ceaf4c-d899-48e2-a41c-f1751168e11b service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.039895 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-c2147b73-179c-40c9-88b5-39529b29cbc8 req-48ceaf4c-d899-48e2-a41c-f1751168e11b service nova] Creating event network-changed:c053b7b1-6ef3-43e4-9697-4f9502b323cb for instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 on hv-cinder-83697 Jun 20 12:23:25.059939 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-c2147b73-179c-40c9-88b5-39529b29cbc8 req-48ceaf4c-d899-48e2-a41c-f1751168e11b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.423183 Jun 20 12:23:25.060820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 27/59] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:25.068104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:25.069201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:25.078779 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.079679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.080886 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.081572 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.508211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:25.523594 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9cedc71f-fb38-48b0-87b1-7eaa589db711 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1298 microversion: 2.1 time: 0.582321 Jun 20 12:23:25.526093 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 33/60] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:24 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1298 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:25.537837 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8a3189c2-b74a-46f7-a4e6-1e9d2fe1ed66 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe2915bd940>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:25.736372 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8a3189c2-b74a-46f7-a4e6-1e9d2fe1ed66 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.207433 Jun 20 12:23:25.736967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 34/61] 10.222.0.64 () {58 vars in 1169 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:25.745276 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:25.748852 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:25.763801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.769737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.770832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.771402 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.826520 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:25.838957 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e606e63d-23f9-4c1b-abf1-41efb06c162e tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.776112 Jun 20 12:23:25.841100 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 28/62] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:25.852118 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:25.857469 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:25.863273 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:25.873074 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.877766 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.878860 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:25.882667 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:25.919174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:25.929542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5896f89a-2362-455f-88f1-ec78f8a22e7a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1294 microversion: 2.1 time: 0.191085 Jun 20 12:23:25.930219 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 35/63] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1294 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:25.961392 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fe5c1088-11d5-42e5-bfa3-5fe29d90c087 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe29166fca0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.156368 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fe5c1088-11d5-42e5-bfa3-5fe29d90c087 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.225048 Jun 20 12:23:26.157498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 36/64] 10.222.0.64 () {58 vars in 1154 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:26.171157 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-79be853c-976e-493d-b786-a43a889d551b tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe2915b10d0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.362183 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:26.364300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-79be853c-976e-493d-b786-a43a889d551b tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.197909 Jun 20 12:23:26.364902 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 37/65] 10.222.0.64 () {58 vars in 1187 bytes} [Mon Jun 20 12:23:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:26.378889 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a69489e8-f089-41bc-a68a-6e6b3c65c4a8 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] Calling method '.version_select at 0x7fe2915d18b0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.425380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-306a9227-5922-4a5e-9280-944a0e22dbb4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.570718 Jun 20 12:23:26.429337 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 29/66] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:25 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:26.556678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.557863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a69489e8-f089-41bc-a68a-6e6b3c65c4a8 tempest-VolumesTestJSON-1217709032 tempest-VolumesTestJSON-1217709032-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.185167 Jun 20 12:23:26.558200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:26.559543 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 38/67] 10.222.0.64 () {58 vars in 1154 bytes} [Mon Jun 20 12:23:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:26.615009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.618692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.623051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.623733 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.861157 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:26.862815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:26.885779 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.891157 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:26.893186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:26.895652 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.409083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:27.419377 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-918e5c85-98c6-446d-871a-86c012260c90 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.561981 Jun 20 12:23:27.419951 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 39/68] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:26 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:27.425227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:27.428341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:27.434948 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.435394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.436252 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.437230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.498046 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:27.512789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d2e3e25a-c05a-4de1-b151-1f0f890eb143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.969498 Jun 20 12:23:27.514406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 30/69] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:26 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:27.520702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:27.521559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:27.529933 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.530586 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.531402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.531850 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.680518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:27.688127 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c6bea54f-d5cf-4da0-99f6-f3ad4e147f07 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.266812 Jun 20 12:23:27.688704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 40/70] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:27 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:27.697830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:27.706267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-ae9c2d18-986e-47f3-a1c4-23e8cc9fe9ae req-fc142939-f5e7-4dc4-b195-dee5bdd5e502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce80a92-cf20-4b98-9d4e-3d8dd0d42d54", "tag": "d5ebea9e-5c66-4f1f-93e8-d61c4bb9fe29"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:27.710404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a958d29c-7924-4466-9088-8ece9821bf62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.194273 Jun 20 12:23:27.711284 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 31/71] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:27 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:27.744037 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ae9c2d18-986e-47f3-a1c4-23e8cc9fe9ae req-fc142939-f5e7-4dc4-b195-dee5bdd5e502 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.744485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ae9c2d18-986e-47f3-a1c4-23e8cc9fe9ae req-fc142939-f5e7-4dc4-b195-dee5bdd5e502 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.785682 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-ae9c2d18-986e-47f3-a1c4-23e8cc9fe9ae req-fc142939-f5e7-4dc4-b195-dee5bdd5e502 service nova] Creating event network-changed:d5ebea9e-5c66-4f1f-93e8-d61c4bb9fe29 for instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 on hv-cinder-83697 Jun 20 12:23:27.786251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ae9c2d18-986e-47f3-a1c4-23e8cc9fe9ae req-fc142939-f5e7-4dc4-b195-dee5bdd5e502 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118092) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 12:23:27.795218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603f161d-77f7-439d-8002-8c4f27bd869d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.797219 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603f161d-77f7-439d-8002-8c4f27bd869d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.798283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603f161d-77f7-439d-8002-8c4f27bd869d None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:27.800809 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603f161d-77f7-439d-8002-8c4f27bd869d None None] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:27.809789 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:27.820590 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.compute.rpcapi [None req-603f161d-77f7-439d-8002-8c4f27bd869d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 12:23:27.823136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603f161d-77f7-439d-8002-8c4f27bd869d None None] Releasing lock "compute-rpcapi-router" {{(pid=118092) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 12:23:27.872443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-603f161d-77f7-439d-8002-8c4f27bd869d None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182194 Jun 20 12:23:27.873698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 41/72] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:28.437229 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:28.438033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:28.446503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.447016 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.447982 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.448634 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.537193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:28.537981 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:28.545610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.546102 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.547037 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.547476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.620803 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:28.628729 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a99b4c70-27ae-402a-afce-e1cbcacd52f5 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.196003 Jun 20 12:23:28.630281 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 32/73] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:28 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:28.696686 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:28.704424 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:28.704938 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c3e38812-9f01-4e58-aa34-f1a451a39214 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.176993 Jun 20 12:23:28.705203 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:28.705530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 42/74] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:28 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:28.711615 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.712366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.713201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.713841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.730875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:28.732457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:28.743899 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.744725 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.746023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:28.746829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:28.910863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:28.921502 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b14e82ac-6463-4d97-929d-c7f164ce99d3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.196213 Jun 20 12:23:28.922466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 43/75] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:28 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:28.924509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:28.938090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8c8fa3c0-b1d4-44cd-b9f2-d2ad9e650748 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.234064 Jun 20 12:23:28.938090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 33/76] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:28 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:29.647549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:29.648217 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:29.654560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:29.656652 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.657317 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.658365 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.659026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.725480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:29.727099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:29.732895 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=30 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:29.735940 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.736669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.737525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.738065 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.946651 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:29.968690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b7ccf4ff-fc4d-4b06-ac62-57fc69c4b976 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.248534 Jun 20 12:23:29.969693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 34/77] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:29 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:29.975834 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:29.976653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:29.984511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.985090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:29.986097 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:29.986610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.156899 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:30.168551 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f8941f6f-3107-4f2e-bd26-6c1035a8b981 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.525368 Jun 20 12:23:30.180597 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 44/78] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:29 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:30.185408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:30.192649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:30.203101 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:30.214578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.215417 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:30.216517 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.237294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:30.246445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8aa61457-1a3c-4aa1-8c3c-916f9b979763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.275514 Jun 20 12:23:30.256679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 35/79] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:29 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:30.271037 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-3fe6d8e6-3830-42a0-a474-056206f3ef71 req-ba1bb8d0-51a0-4da8-849a-89b71a706234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a331a3-6307-47a9-b9b8-cd94a0217c11", "tag": "93788802-61f0-473d-9861-00643d29473b"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:30.286129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-3fe6d8e6-3830-42a0-a474-056206f3ef71 req-ba1bb8d0-51a0-4da8-849a-89b71a706234 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:30.286974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-3fe6d8e6-3830-42a0-a474-056206f3ef71 req-ba1bb8d0-51a0-4da8-849a-89b71a706234 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:30.305708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-3fe6d8e6-3830-42a0-a474-056206f3ef71 req-ba1bb8d0-51a0-4da8-849a-89b71a706234 service nova] Creating event network-changed:93788802-61f0-473d-9861-00643d29473b for instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 on hv-cinder-83697 Jun 20 12:23:30.312023 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-3fe6d8e6-3830-42a0-a474-056206f3ef71 req-ba1bb8d0-51a0-4da8-849a-89b71a706234 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053725 Jun 20 12:23:30.312916 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 36/80] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:30.513471 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=24 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:30.537729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:30.555009 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1c7de8ff-423e-4fab-b2c8-54b7b7d3bb99 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.373266 Jun 20 12:23:30.558041 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 45/81] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:30 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:30.987441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:30.988465 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:30.995352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:30.995844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.003335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.003335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.019165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:31.147390 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:31.155265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4b8e1146-418a-40df-aa58-6d73c24d9815 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.172620 Jun 20 12:23:31.155847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 37/82] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:30 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:31.185081 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:31.185697 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:31.192858 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.193319 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.194106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.194566 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.265388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:31.266347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:31.274631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.275079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.275839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.276270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.329012 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:31.338235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-82234f93-7851-4753-b1d6-8d120be00c0f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.156886 Jun 20 12:23:31.338810 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 46/83] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:31 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:31.428237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:31.448237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e7b03828-b07a-4b6d-9413-b1c82d5ca8eb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.177333 Jun 20 12:23:31.448237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 38/84] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:31 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:31.573128 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:31.573743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:31.579963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.580351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.581119 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:31.581562 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:31.733698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:31.743028 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-30f59479-e379-4a21-b1ac-b1f675edd328 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.173733 Jun 20 12:23:31.743788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 47/85] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:31 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:32.172563 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:32.173107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:32.179247 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.179713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.180475 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.180908 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.310491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:32.318332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-146dd5df-c0aa-4a19-a8fd-b175fae98716 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.149828 Jun 20 12:23:32.318902 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 39/86] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:32 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:32.355442 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:32.356077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:32.362460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.362910 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.363797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.364304 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.455229 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:32.455854 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:32.462751 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.463204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.463983 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.464421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.496794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:32.505473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d66056e1-39a8-417d-a820-43f321a0ec24 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.153355 Jun 20 12:23:32.506075 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 48/87] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:32 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:32.602972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:32.610552 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ceb4f33b-39f6-4006-a152-2c7719a9631a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.159339 Jun 20 12:23:32.611107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 40/88] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:32 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:32.762315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:32.763439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:32.770935 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.774286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.774286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:32.774286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:32.958255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:32.966199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e7b3adf9-94a8-440d-b2af-9c5b2b7d3506 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.210110 Jun 20 12:23:32.966877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 49/89] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:32 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:33.335172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:33.335790 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:33.341722 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=6 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:33.343856 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.344314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.345256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.345710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.523518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:33.524257 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:33.537994 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.539402 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.542491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.550445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.559236 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:33.568699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-eefb45b4-cffe-46e6-8deb-257478badc83 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.237866 Jun 20 12:23:33.571621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 41/90] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:33 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:33.629228 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:33.630057 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:33.637781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.638639 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.639683 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.640296 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.785118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:33.794791 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a3d86587-9210-45b2-ae13-17ca33ca98b8 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.275350 Jun 20 12:23:33.795463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 50/91] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:33 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:33.855497 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:33.864567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f61130cb-fc6a-499f-a71f-dc0b8ddd9dda tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.239894 Jun 20 12:23:33.865417 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 42/92] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:33 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:33.984200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:33.984804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:33.992030 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.992708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:33.993636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:33.994251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.230916 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-203835310", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "networks": [{"uuid": "89eaf5ff-cfa0-4bc1-b1fb-2999f907b8cf"}]}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:34.244851 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:34.260847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2654466e-5c5a-4362-bc1d-a03a2bbdb246 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.280510 Jun 20 12:23:34.262768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 51/93] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:33 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:34.345658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] validate_networks() for [('89eaf5ff-cfa0-4bc1-b1fb-2999f907b8cf', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:23:34.587605 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:34.589035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:34.595654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.596329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.597251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.597764 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.884245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:34.884245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a9a704fd-e730-4623-b7d0-14808791cc52 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.189636 Jun 20 12:23:34.884245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 52/94] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:34 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:34.884635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:23:34.884635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:23:34.884635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:23:34.884635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:23:34.884635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:23:34.885077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.885077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.885077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.885077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.885421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:34.885421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:34.885421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.885421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.885726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Getting quotas for project f91f86e458674558b7b62cdd9e945eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:23:34.885875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:34.885875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:34.886036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Getting quotas for user 14654ec95611472da8f89705599da7db and project f91f86e458674558b7b62cdd9e945eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:23:34.886036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:23:34.886036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:23:35.053647 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:35.053647 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-abbf681c-27fe-4051-83e6-3e2d0297da4b tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.175157 Jun 20 12:23:35.053647 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 53/95] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:34 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:35.053647 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:35.054577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:35.054577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.054577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.054577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.055018 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.240353 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c4ac6728-93d1-4f00-8066-1d4102f62783 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013792 Jun 20 12:23:35.241051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 43/96] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:23:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:23:35.252919 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-aeca1365-ef83-4c81-939b-77333bb0beb2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:35.253533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-aeca1365-ef83-4c81-939b-77333bb0beb2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:35.372394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-aeca1365-ef83-4c81-939b-77333bb0beb2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:35.408949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-aeca1365-ef83-4c81-939b-77333bb0beb2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1213 microversion: 2.1 time: 0.159728 Jun 20 12:23:35.409555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 44/97] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:35 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:35.427845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:35.429691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:35.445133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.445697 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.450604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.451373 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.512964 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:35.521191 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-53482fe1-c4cc-4789-9a59-44dc0dd1790b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.535026 Jun 20 12:23:35.524643 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 54/98] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:34 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:35.645837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:35.653623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8f10c08d-e62d-4bff-b40f-1ff73285ef4b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.241953 Jun 20 12:23:35.654223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 45/99] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:35 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:35.894930 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:35.896878 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:35.911446 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.912034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:35.914195 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:35.914645 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.018153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-a60fcbdc-022d-4259-9471-4b31de80b95f req-84b0e8fe-6eab-46ab-9a4f-6b3979ab299c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b954edf9-f964-4714-b270-e9f9ee51a80a", "tag": "cd7e676c-79aa-4b40-999b-85ed6d43f711"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:36.034042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-a60fcbdc-022d-4259-9471-4b31de80b95f req-84b0e8fe-6eab-46ab-9a4f-6b3979ab299c service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.037702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-a60fcbdc-022d-4259-9471-4b31de80b95f req-84b0e8fe-6eab-46ab-9a4f-6b3979ab299c service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.073188 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-a60fcbdc-022d-4259-9471-4b31de80b95f req-84b0e8fe-6eab-46ab-9a4f-6b3979ab299c service nova] Creating event network-changed:cd7e676c-79aa-4b40-999b-85ed6d43f711 for instance b954edf9-f964-4714-b270-e9f9ee51a80a on hv-cinder-83697 Jun 20 12:23:36.081790 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-a60fcbdc-022d-4259-9471-4b31de80b95f req-84b0e8fe-6eab-46ab-9a4f-6b3979ab299c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068977 Jun 20 12:23:36.083413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 46/100] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:36.090686 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:36.091664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:36.099590 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.108841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.108841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.108841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.117581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:36.126333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-04b13c20-9e1d-48a8-b4df-ce8db0bc38d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.235984 Jun 20 12:23:36.127306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 55/101] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:35 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:36.334641 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:36.342661 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d5ea4983-9f40-4c94-874c-bbef2743ead2 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.257667 Jun 20 12:23:36.343965 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 47/102] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:36 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:36.428069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-defebd2f-dbc0-4876-a9fb-1b3354069cc8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:36.428944 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-defebd2f-dbc0-4876-a9fb-1b3354069cc8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:36.522541 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-defebd2f-dbc0-4876-a9fb-1b3354069cc8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:36.534720 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-defebd2f-dbc0-4876-a9fb-1b3354069cc8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1213 microversion: 2.1 time: 0.112254 Jun 20 12:23:36.538679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 56/103] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:36 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:36.541599 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:36.542309 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:36.549710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.550436 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.553719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.554249 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.670592 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:36.671579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:36.678273 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.678831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.680399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:36.681043 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:36.723821 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:36.742555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b8f54535-95fb-4e54-9095-a0ef42586359 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.204682 Jun 20 12:23:36.752028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 48/104] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:36 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:36.856531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:36.864396 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f11f7e8c-5efa-4620-8dcc-a8f01a2eb727 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.197732 Jun 20 12:23:36.865143 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 57/105] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:36 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:37.147028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:37.147028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:37.151469 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.152165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.153002 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.153402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.289291 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:37.296908 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8f203a1e-7b30-42d0-b246-484a6192545f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.156574 Jun 20 12:23:37.297477 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 49/106] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:37 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:37.360172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:37.360776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:37.373703 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.374184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.380087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.380593 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.556727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:37.557408 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:37.564876 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.565680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.568351 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.568954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.678580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:37.691821 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5aacabcc-c02b-45be-895d-b2dc14b9988c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1217 microversion: 2.1 time: 0.140592 Jun 20 12:23:37.693483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 50/107] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:37 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:37.760242 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:37.760850 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:37.787802 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.788255 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.789038 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.789475 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.810841 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:37.961015 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:37.969477 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2297441e-9b61-45a6-b989-cd2e54dad727 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.213381 Jun 20 12:23:37.970403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 51/108] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:37 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:37.976761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:37.977472 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:37.984814 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.985597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:37.986569 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:37.987296 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.080167 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:38.099575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-836a8d11-3b58-49a1-ab25-6df21dde788c tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.734591 Jun 20 12:23:38.100241 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 58/109] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:37 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:38.195762 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:38.200001 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-20f124fc-1f5a-4977-a379-9ce8c42a7862 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.228320 Jun 20 12:23:38.200760 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 52/110] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:37 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:38.319780 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:38.320583 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:38.329354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.330640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.330640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.331011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.353250 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:38.640003 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:38.659238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-150f6b8c-9aed-4fc1-a2d7-8c649760e555 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.345697 Jun 20 12:23:38.660159 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 59/111] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:38 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:38.710823 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:38.711639 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:38.718629 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.719500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.720496 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.721187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.806686 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:38.814357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-04ec225f-a420-4448-8366-b97aeca43441 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1265 microversion: 2.1 time: 0.108425 Jun 20 12:23:38.817080 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 53/112] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:38 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:38.987493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:38.988109 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:38.994814 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.995266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:38.996028 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:38.996466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.116641 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:39.117266 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:39.124438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.125603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.127306 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.128020 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.195970 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:39.197433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0803b92b-ffc4-4e2a-af15-c824aa09fa62 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.213892 Jun 20 12:23:39.198579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 60/113] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:38 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:39.220379 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:39.221308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:39.235536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.236258 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.239987 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.241262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.327589 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:39.335978 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ece384fd-2f7c-4f70-953b-db7f0fb612c0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.223403 Jun 20 12:23:39.336558 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 54/114] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:39 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:39.455666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:39.463799 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0af699b1-4137-4ee3-bf23-926601f418f5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.250270 Jun 20 12:23:39.475059 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 61/115] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:39 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:39.677938 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:39.678887 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:39.685244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.686060 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.687363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.687876 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.838484 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:39.841607 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:39.851874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.853573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.855163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:39.855771 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:39.959477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:39.971693 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fd4cff0f-7359-4559-93f3-6a1b2801994c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1283 microversion: 2.1 time: 0.140472 Jun 20 12:23:39.974323 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 62/116] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:39 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1283 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:39.979923 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:39.987251 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3676f31d-fbce-453b-aff1-c21d25cb5daf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.314672 Jun 20 12:23:39.987817 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 55/117] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:39 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:40.263315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:40.263315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:40.263315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.263315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.263969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.263969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.354952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:40.355901 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:40.364806 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.365627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.366608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.367114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.375915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:40.393180 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:40.398308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b4bbcf87-6971-4974-9131-5210d58b11e6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.186388 Jun 20 12:23:40.399078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 63/118] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:40 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:40.481448 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:40.482090 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:40.488955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.488955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.490129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:40.490564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:40.528929 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:40.536899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c9f691b3-d6d6-4827-a827-04692150b774 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.186706 Jun 20 12:23:40.537519 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 56/119] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:40 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:40.779169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:40.787435 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9b215490-ecc5-416b-9097-8e67d71a1242 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.310231 Jun 20 12:23:40.788006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 64/120] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:40 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:40.991070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:40.992044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:41.003627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.005018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.007070 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:41.007514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.008465 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:41.008603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.015037 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.015781 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.016769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.017210 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.090754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:41.100818 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3aed44ba-4566-44dd-93f7-9d3a62ee06ca tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1271 microversion: 2.1 time: 0.115585 Jun 20 12:23:41.101402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 57/121] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:40 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:41.224792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:41.234821 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-aa6945fc-18bd-4bd9-a651-1b31df89f57a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.232992 Jun 20 12:23:41.235405 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 65/122] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:41 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:41.415770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:41.416381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:41.423923 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.425772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.427214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.427654 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.555568 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:41.556577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:41.563515 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.569289 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.569731 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:41.572894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.573625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.578531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-079faff2-7499-480f-9faf-bb3f57f131df tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.166366 Jun 20 12:23:41.579120 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 58/123] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:41 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:41.763174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:41.771450 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-aebf9b19-aaaf-414a-8a5d-cde3a7dae888 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.219732 Jun 20 12:23:41.772571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 66/124] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:41 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:41.775981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-75406123-4bae-47f7-9f70-770a41bb9da5 req-f072881b-fbba-455d-99ab-bb10b7ddac83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2c0d3f-5fbd-486e-98fa-9056dde04005", "name": "network-vif-plugged", "status": "completed", "tag": "c053b7b1-6ef3-43e4-9697-4f9502b323cb"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:41.787131 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-75406123-4bae-47f7-9f70-770a41bb9da5 req-f072881b-fbba-455d-99ab-bb10b7ddac83 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.790627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-75406123-4bae-47f7-9f70-770a41bb9da5 req-f072881b-fbba-455d-99ab-bb10b7ddac83 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.805236 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:41.806070 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:41.817975 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.819011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.822547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:41.823165 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:41.841603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-75406123-4bae-47f7-9f70-770a41bb9da5 req-f072881b-fbba-455d-99ab-bb10b7ddac83 service nova] Creating event network-vif-plugged:c053b7b1-6ef3-43e4-9697-4f9502b323cb for instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 on hv-cinder-83697 Jun 20 12:23:41.852833 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-75406123-4bae-47f7-9f70-770a41bb9da5 req-f072881b-fbba-455d-99ab-bb10b7ddac83 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165475 Jun 20 12:23:41.854636 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 59/125] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:42.015311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:42.035957 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-42c360f2-b912-4602-bda8-dadceeeddbe9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.235116 Jun 20 12:23:42.043009 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 67/126] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:41 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:42.121082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:42.123431 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:42.132465 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.133196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.134322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.134986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.252817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:42.253731 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:42.261740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.263314 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.264770 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.265466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.487806 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:42.502248 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1501a7be-6ba4-49ab-ba7d-dc9f015fb2f9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.253039 Jun 20 12:23:42.503036 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 68/127] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:42 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:42.595637 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:42.596362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:42.606067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.609274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.609274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.609274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.684329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:42.694910 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f7534316-08f0-4f4b-8e0f-8e3d1284f5d4 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.579235 Jun 20 12:23:42.710538 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 60/128] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:42 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:42.789093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:42.790001 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:42.798349 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:42.803514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.803970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.804951 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:42.805593 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:42.807931 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2bf65061-4af3-4591-a3dc-a11ac7c46f4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.216474 Jun 20 12:23:42.808651 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 69/129] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:42 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:43.061531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:43.062135 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:43.075161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.076860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.086394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.087368 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.106530 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:43.117123 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-071e0409-1056-4cf2-9e5a-dfd67c4df6d0 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.332439 Jun 20 12:23:43.117700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 61/130] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:42 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:43.437420 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-f6f25e3d-2b21-4501-ad7c-f4940bda808a req-ebc64b4c-b82a-43b7-8829-252623ce9eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86da428-35a0-45a5-86e4-ac5a197b5781", "tag": "8c000653-6035-4513-850d-5081c6c0557f"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:43.451979 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f6f25e3d-2b21-4501-ad7c-f4940bda808a req-ebc64b4c-b82a-43b7-8829-252623ce9eb2 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.452680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f6f25e3d-2b21-4501-ad7c-f4940bda808a req-ebc64b4c-b82a-43b7-8829-252623ce9eb2 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.469366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-f6f25e3d-2b21-4501-ad7c-f4940bda808a req-ebc64b4c-b82a-43b7-8829-252623ce9eb2 service nova] Creating event network-changed:8c000653-6035-4513-850d-5081c6c0557f for instance d86da428-35a0-45a5-86e4-ac5a197b5781 on hv-cinder-83697 Jun 20 12:23:43.473370 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-f6f25e3d-2b21-4501-ad7c-f4940bda808a req-ebc64b4c-b82a-43b7-8829-252623ce9eb2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041581 Jun 20 12:23:43.474261 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 62/131] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:43.523595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:43.524404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:43.529734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:43.533284 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.533882 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.535308 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.535875 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.545470 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0f5816e2-b9d6-4eda-94ef-20bcb584b3c3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.488172 Jun 20 12:23:43.549089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 70/132] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:43 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:43.712239 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:43.712849 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:43.719203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.719658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.720416 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.723261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.839487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:43.847120 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f672168e-b0a8-4729-87df-f6fb54412c9d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.330217 Jun 20 12:23:43.847811 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 63/133] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:43 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:43.852262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:43.852920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:43.859278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.859667 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.860429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.860867 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.865745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:43.873590 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-dfbf3146-4494-4ed0-8794-c6812d2d9e36 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.165378 Jun 20 12:23:43.874217 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 71/134] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:43 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:43.882122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-edb064f0-9df4-4394-afd0-35f50a3b7f7a req-6e5ff88f-6fa0-415b-bfe1-2056d9378c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108e8e51-7234-4ddc-9ff6-6e2bfed530ff", "name": "network-vif-plugged", "status": "completed", "tag": "ec887b68-8427-4b8e-94d0-cd7c4c5dd881"}, {"server_uuid": "d4a331a3-6307-47a9-b9b8-cd94a0217c11", "name": "network-vif-plugged", "status": "completed", "tag": "93788802-61f0-473d-9861-00643d29473b"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:43.895316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-edb064f0-9df4-4394-afd0-35f50a3b7f7a req-6e5ff88f-6fa0-415b-bfe1-2056d9378c9b service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:43.896121 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-edb064f0-9df4-4394-afd0-35f50a3b7f7a req-6e5ff88f-6fa0-415b-bfe1-2056d9378c9b service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:43.910648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-edb064f0-9df4-4394-afd0-35f50a3b7f7a req-6e5ff88f-6fa0-415b-bfe1-2056d9378c9b service nova] Creating event network-vif-plugged:ec887b68-8427-4b8e-94d0-cd7c4c5dd881 for instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff on hv-cinder-83697 Jun 20 12:23:43.911554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-edb064f0-9df4-4394-afd0-35f50a3b7f7a req-6e5ff88f-6fa0-415b-bfe1-2056d9378c9b service nova] Creating event network-vif-plugged:93788802-61f0-473d-9861-00643d29473b for instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 on hv-cinder-83697 Jun 20 12:23:43.921091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-edb064f0-9df4-4394-afd0-35f50a3b7f7a req-6e5ff88f-6fa0-415b-bfe1-2056d9378c9b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043333 Jun 20 12:23:43.922115 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 72/135] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:44.002580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:44.010969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1884af69-ef23-4059-9410-cd22f87609a9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.162158 Jun 20 12:23:44.011540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 64/136] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:43 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:44.134341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:44.135049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:44.141360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.141748 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.142542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.142978 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.281986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:44.290816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ed5ed408-98dc-4e39-8a03-8f776a1635a1 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.160771 Jun 20 12:23:44.291376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 73/137] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:44 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:44.564157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:44.564926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:44.571032 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.571484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.572244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.572682 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.734719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:44.742861 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cbc57177-75a9-4df3-a31f-15b4492a55a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.183355 Jun 20 12:23:44.743423 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 65/138] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:44 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:44.864485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:44.865321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:44.871811 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.872467 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.873246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.873679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.896342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:44.897952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:44.901563 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:44.908128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.908128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:44.908654 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:44.909257 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.014895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:45.023594 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-614f22f8-844f-464a-9442-0bfcb1b76e1b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.163702 Jun 20 12:23:45.024171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 74/139] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:44 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:45.029301 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:45.030188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:45.036397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.036845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.037963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.038406 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.048673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:45.056754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c493bf29-89ba-4c81-b36c-b6a713fcdbb8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.166783 Jun 20 12:23:45.057326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 66/140] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:44 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:45.167768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:45.176284 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e9bb4f00-64a9-4a21-afc1-f75b39ec8889 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.150431 Jun 20 12:23:45.177097 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 75/141] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:45 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:45.307268 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:45.307883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:45.314058 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.314513 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.315283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.320918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.397048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=8 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:45.453225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:45.462042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c609b37b-cfca-4966-b0eb-c306cf0f54dd tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.157928 Jun 20 12:23:45.462042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 67/142] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:45 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:45.759671 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:45.760411 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:45.766624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.767203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.768017 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:45.768454 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:45.900039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:45.903844 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:45.908288 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-375cb938-1209-46dc-aca1-a8f40afac6a9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.152598 Jun 20 12:23:45.908869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 76/143] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:45 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:46.041410 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.042293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:46.048724 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.049167 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.049948 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.050383 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.074094 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.074702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:46.082665 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.083107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.083872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.084298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.198681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:46.207368 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a5ed209a-648f-4e67-9437-e60bddc66a12 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.169067 Jun 20 12:23:46.208367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 68/144] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:46 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:46.216266 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.217125 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:46.234734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.235809 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.236881 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.237471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.246270 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:46.255684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b20e114c-b168-49bd-a514-02131d19e180 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.185266 Jun 20 12:23:46.256363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 77/145] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:46 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:46.479746 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.480366 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:46.486781 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.487253 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.488269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.488849 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.528259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:46.598366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:46.612340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c1e7e10a-2ff9-44a8-a203-f0cfa01d6166 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.400538 Jun 20 12:23:46.612986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 69/146] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:46 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:46.677005 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:46.685097 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-43ba3631-8449-460b-b12e-e359af102fae tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1314 microversion: 2.1 time: 0.209378 Jun 20 12:23:46.685831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 78/147] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:46 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:46.927029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:46.927657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:46.934385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.934835 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:46.935770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:46.936213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.085783 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:47.093396 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0579ee4a-9241-4a1a-a41f-d9d0cdd0b5f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.171126 Jun 20 12:23:47.093987 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 70/148] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:46 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:47.225522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:47.226520 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:47.233752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.234435 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.235375 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.235955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.275090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:47.276459 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:47.284620 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:47.288042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.288640 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.289925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.290505 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.540602 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:47.557011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-63563793-9a34-492f-95b3-167e38910b11 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.336240 Jun 20 12:23:47.559448 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 79/149] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:47 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:47.584576 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:47.592822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b13b3f07-07ce-4201-81c4-704bad30b7cf tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.323812 Jun 20 12:23:47.593912 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 71/150] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:47 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:47.630543 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:47.631157 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:47.637772 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.638252 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.639179 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.639768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.702502 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:47.703210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:47.709872 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.710402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.711262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:47.711776 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:47.781685 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:47.789995 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-eda525b7-1d74-4d0d-b9a7-f755819fdf07 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.163618 Jun 20 12:23:47.790879 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 80/151] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:47 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:47.844213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:47.852432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-091c1241-55a9-4bdd-a0ac-f8c0991c4341 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1501 microversion: 2.1 time: 0.153830 Jun 20 12:23:47.853075 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 72/152] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:47 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:48.111670 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:48.112513 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:48.119204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.119887 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.120610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.121126 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.283931 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:48.290717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b71aa5e8-9169-4de1-b07b-21816754e73e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.182872 Jun 20 12:23:48.291231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 81/153] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:48 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:48.576216 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:48.576825 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:48.584165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.584610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.585369 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.585826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.610538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:48.611280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:48.617205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.617642 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.618434 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.618868 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.749395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:48.762420 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-38afe493-cf9f-49a1-8a1c-f93cd4ad9443 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.189614 Jun 20 12:23:48.772954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 73/154] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:48 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:48.796569 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:48.807223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:48.807420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-db773a57-e0e0-4c8b-9e7a-50559cefe542 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.200705 Jun 20 12:23:48.808145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:48.814502 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.820544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.820544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:48.820544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:48.821178 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 82/155] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:48 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:48.840521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:48.973988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:48.979092 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-eeb4faa7-37da-4e79-b734-87203a061b85 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.175897 Jun 20 12:23:48.979695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 74/156] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:48 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:49.307758 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:49.308363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:49.314499 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:49.314945 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:49.315756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:49.316799 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:49.449014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:49.456786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0fd9fcc7-2c25-45b0-93a3-ab95600bff04 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.153037 Jun 20 12:23:49.457761 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 83/157] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:49 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:49.546709 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-d136fbea-e992-4977-9555-bf6d2f4573ce req-2cbf2a30-941e-4df7-baea-cdb2587122ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b954edf9-f964-4714-b270-e9f9ee51a80a", "name": "network-vif-plugged", "status": "completed", "tag": "cd7e676c-79aa-4b40-999b-85ed6d43f711"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:49.556307 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-d136fbea-e992-4977-9555-bf6d2f4573ce req-2cbf2a30-941e-4df7-baea-cdb2587122ce service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:49.556744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-d136fbea-e992-4977-9555-bf6d2f4573ce req-2cbf2a30-941e-4df7-baea-cdb2587122ce service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:49.569091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-d136fbea-e992-4977-9555-bf6d2f4573ce req-2cbf2a30-941e-4df7-baea-cdb2587122ce service nova] Creating event network-vif-plugged:cd7e676c-79aa-4b40-999b-85ed6d43f711 for instance b954edf9-f964-4714-b270-e9f9ee51a80a on hv-cinder-83697 Jun 20 12:23:49.576183 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-d136fbea-e992-4977-9555-bf6d2f4573ce req-2cbf2a30-941e-4df7-baea-cdb2587122ce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032740 Jun 20 12:23:49.577335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 75/158] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:49.780641 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:49.781256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:49.787367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:49.787817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:49.788640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:49.789077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:49.826747 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:49.829841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:49.846597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:49.850913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:49.851966 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:49.852542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:49.936624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:49.945734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f8cacba7-e86d-411b-9429-bb035d8b900a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.169323 Jun 20 12:23:49.956698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 84/159] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:49 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:49.995838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:49.996572 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:50.002827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.003424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.004884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.005308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.031152 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:50.039727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6df6ae83-97fc-4c36-83c7-46fbe69a5eec tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.217261 Jun 20 12:23:50.040656 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 76/160] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:49 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:50.142374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:50.150085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-40d185f2-ac00-46aa-a14a-f96fe39a3747 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.158121 Jun 20 12:23:50.150648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 85/161] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:49 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:50.474880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:50.475605 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:50.481554 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.482043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.482815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.483255 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.618737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:50.626169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0d7d0c50-fb6e-4419-b31b-21c2ea501224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1362 microversion: 2.1 time: 0.155731 Jun 20 12:23:50.626741 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 77/162] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:50 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:50.963668 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:50.964271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:50.970360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.970799 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:50.971540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:50.971963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.056886 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:51.057534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:51.063625 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.064078 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.064849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.065295 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.103023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:51.111529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-30c267a6-4d43-44ce-b551-8be4aa4e7357 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.150897 Jun 20 12:23:51.111529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 86/163] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:50 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:51.167161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:51.167827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:51.174161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.174604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.176209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.176677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.196394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:51.203856 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a69ee43b-3a82-4a3b-a495-40de5b526c12 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.150827 Jun 20 12:23:51.204424 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 78/164] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:51 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:51.320796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:51.328407 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-65c8bed0-6600-46de-8cdb-28b42016507a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.165146 Jun 20 12:23:51.328985 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 87/165] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:51 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:51.591689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-82cce124-fef6-48c7-9147-0247df72dec4 req-25538faf-be2d-4e88-8bc5-fd0513e2228a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce80a92-cf20-4b98-9d4e-3d8dd0d42d54", "name": "network-vif-plugged", "status": "completed", "tag": "d5ebea9e-5c66-4f1f-93e8-d61c4bb9fe29"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:51.603057 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-82cce124-fef6-48c7-9147-0247df72dec4 req-25538faf-be2d-4e88-8bc5-fd0513e2228a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.603495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-82cce124-fef6-48c7-9147-0247df72dec4 req-25538faf-be2d-4e88-8bc5-fd0513e2228a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.614796 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-82cce124-fef6-48c7-9147-0247df72dec4 req-25538faf-be2d-4e88-8bc5-fd0513e2228a service nova] Creating event network-vif-plugged:d5ebea9e-5c66-4f1f-93e8-d61c4bb9fe29 for instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 on hv-cinder-83697 Jun 20 12:23:51.619528 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-82cce124-fef6-48c7-9147-0247df72dec4 req-25538faf-be2d-4e88-8bc5-fd0513e2228a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Jun 20 12:23:51.620107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 79/166] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:51.644024 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:51.645712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:51.652336 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.652776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.653909 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.654377 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.788443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:51.796096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a04d936b-b70a-47e0-9396-074c58fbdb90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1548 microversion: 2.1 time: 0.156084 Jun 20 12:23:51.796655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 88/167] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:51 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:51.814343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-96a26d9d-4053-48c9-ad81-38e2862c7dbe tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:51.815001 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-96a26d9d-4053-48c9-ad81-38e2862c7dbe tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:51.821412 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-96a26d9d-4053-48c9-ad81-38e2862c7dbe tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.821887 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-96a26d9d-4053-48c9-ad81-38e2862c7dbe tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.822652 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-96a26d9d-4053-48c9-ad81-38e2862c7dbe tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.823084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-96a26d9d-4053-48c9-ad81-38e2862c7dbe tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.960880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-96a26d9d-4053-48c9-ad81-38e2862c7dbe tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150847 Jun 20 12:23:51.961461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 80/168] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:23:51 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:51.967790 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f1b2b23f-672e-4622-9b9e-1278ccbf4f03 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10244883-382b-4bae-ab82-a65b9362d92c"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:51.968932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f1b2b23f-672e-4622-9b9e-1278ccbf4f03 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:51.975888 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1b2b23f-672e-4622-9b9e-1278ccbf4f03 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.976344 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1b2b23f-672e-4622-9b9e-1278ccbf4f03 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:51.977112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1b2b23f-672e-4622-9b9e-1278ccbf4f03 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:51.977548 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1b2b23f-672e-4622-9b9e-1278ccbf4f03 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.131452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:52.133324 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:52.139860 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.140389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.141225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.141728 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.377589 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:52.388325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-65aa1150-e7fe-4bf0-9e53-81988a8c2781 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.263596 Jun 20 12:23:52.398732 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 81/169] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:52 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:52.405340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:52.406019 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:52.417899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.418370 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.419500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.419937 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.761504 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:52.780707 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d042096a-dd01-48fe-8afc-4fd97bf1e3ad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.390404 Jun 20 12:23:52.784250 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 82/170] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:52 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:52.798111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:52.798801 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:52.807384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.808619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:52.809536 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:52.810179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.262240 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:53.270810 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-aca19056-b9db-41ca-95a8-2c499ab4dcab tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.486510 Jun 20 12:23:53.271580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 83/171] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:52 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:53.406687 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:53.407294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:53.413491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.413972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.414735 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.415170 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.624325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:53.633457 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3d33b328-acd5-4388-9eb8-133580839143 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.230831 Jun 20 12:23:53.634240 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 84/172] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:53 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:53.799837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:53.802541 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:53.814454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.814893 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.815708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.816819 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.962527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:53.970397 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-36fd43f0-f7a1-4ead-b343-59c54d1efb7e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.174919 Jun 20 12:23:53.970955 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 85/173] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:53 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:53.975339 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-050e8fb1-68cf-47bd-8c23-cfcf6f03f528 req-e9a09604-5e24-444d-a013-515769cedb85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a331a3-6307-47a9-b9b8-cd94a0217c11", "tag": "93788802-61f0-473d-9861-00643d29473b"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:53.983453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-050e8fb1-68cf-47bd-8c23-cfcf6f03f528 req-e9a09604-5e24-444d-a013-515769cedb85 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:53.984679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-050e8fb1-68cf-47bd-8c23-cfcf6f03f528 req-e9a09604-5e24-444d-a013-515769cedb85 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:53.996299 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-050e8fb1-68cf-47bd-8c23-cfcf6f03f528 req-e9a09604-5e24-444d-a013-515769cedb85 service nova] Creating event network-changed:93788802-61f0-473d-9861-00643d29473b for instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 on hv-cinder-83697 Jun 20 12:23:54.001398 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-050e8fb1-68cf-47bd-8c23-cfcf6f03f528 req-e9a09604-5e24-444d-a013-515769cedb85 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029258 Jun 20 12:23:54.002029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 86/174] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:54.288291 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:54.288992 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:54.295756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f1b2b23f-672e-4622-9b9e-1278ccbf4f03 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "POST /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.331778 Jun 20 12:23:54.296792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 89/175] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:23:51 2022] POST /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005/os-volume_attachments => generated 194 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:23:54.298323 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:54.298763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:54.299734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:54.300691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:54.459443 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:54.468888 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b3b1ec90-a4a5-4ae2-b0d4-3b858fa4e8da tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.184803 Jun 20 12:23:54.485833 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 87/176] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:54 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:23:54.653233 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:54.654702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:54.667029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:54.667900 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:54.669573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:54.670666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:54.858155 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:54.866559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7df70a7b-16c6-403b-82be-74adf817f25c tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1366 microversion: 2.1 time: 0.219806 Jun 20 12:23:54.871462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 90/177] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:54 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:54.988727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:54.990303 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:55.000178 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.000820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:55.002202 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.002863 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:55.247607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:55.256537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-dce96aa4-7507-4a83-ab19-726eb2290c43 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.272577 Jun 20 12:23:55.257653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 88/178] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:54 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:55.489534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:55.490173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:55.496300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.496748 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:55.497514 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.497976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:55.645299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:55.658648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a9c0d5e0-417e-4966-8a76-02c690d565bd tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1322 microversion: 2.1 time: 0.173166 Jun 20 12:23:55.660940 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 91/179] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:55 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:55.883743 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:55.884511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:55.892470 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.893001 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:55.894180 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:55.894826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.047118 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:56.056322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a728d90b-df53-406a-ad24-ab1ae0ea4caf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1556 microversion: 2.1 time: 0.176644 Jun 20 12:23:56.056898 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 89/180] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:55 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:56.074664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5dd3f6c4-2c5f-4b4b-a9b8-a9d9bbd1d9ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:56.078767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5dd3f6c4-2c5f-4b4b-a9b8-a9d9bbd1d9ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:56.095027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5dd3f6c4-2c5f-4b4b-a9b8-a9d9bbd1d9ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.095479 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5dd3f6c4-2c5f-4b4b-a9b8-a9d9bbd1d9ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.096285 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5dd3f6c4-2c5f-4b4b-a9b8-a9d9bbd1d9ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.096716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5dd3f6c4-2c5f-4b4b-a9b8-a9d9bbd1d9ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.105181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:56.186251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5dd3f6c4-2c5f-4b4b-a9b8-a9d9bbd1d9ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115996 Jun 20 12:23:56.194023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 92/181] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:23:56 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:56.274155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:56.274691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:56.283381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.283869 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.285216 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.285825 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.488577 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:56.496640 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4d6da018-9f3b-4b71-b280-e1ab466d02c6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.226675 Jun 20 12:23:56.497623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 90/182] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:56 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:56.677122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:56.679165 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:56.689031 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:56.695269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.695269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.695269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.695729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.920028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-9dcb953a-133a-4fc2-80c5-9389d06bfc74 req-7b031df4-c4bf-41b1-b933-f1d8ebfc7a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86da428-35a0-45a5-86e4-ac5a197b5781", "name": "network-vif-plugged", "status": "completed", "tag": "8c000653-6035-4513-850d-5081c6c0557f"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:56.931951 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-9dcb953a-133a-4fc2-80c5-9389d06bfc74 req-7b031df4-c4bf-41b1-b933-f1d8ebfc7a1e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:56.932371 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-9dcb953a-133a-4fc2-80c5-9389d06bfc74 req-7b031df4-c4bf-41b1-b933-f1d8ebfc7a1e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:56.961043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-9dcb953a-133a-4fc2-80c5-9389d06bfc74 req-7b031df4-c4bf-41b1-b933-f1d8ebfc7a1e service nova] Creating event network-vif-plugged:8c000653-6035-4513-850d-5081c6c0557f for instance d86da428-35a0-45a5-86e4-ac5a197b5781 on hv-cinder-83697 Jun 20 12:23:56.966994 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-9dcb953a-133a-4fc2-80c5-9389d06bfc74 req-7b031df4-c4bf-41b1-b933-f1d8ebfc7a1e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051333 Jun 20 12:23:56.968052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 91/183] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:57.420587 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:57.429845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5375a9e4-42e2-42ad-84b0-078176a5c8f4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1515 microversion: 2.1 time: 0.757188 Jun 20 12:23:57.431238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 93/184] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:56 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1515 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:57.450190 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:57.454892 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:57.458773 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.459906 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.460690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.461297 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.487301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lazy-loading 'flavor' on Instance uuid dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:23:57.521083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:57.522573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:57.533557 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.534039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.538620 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.539283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.685589 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:57.811214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:57.834798 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-44a79725-c51f-4bbd-801a-7afb2ccadc53 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.321001 Jun 20 12:23:57.837526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 94/185] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:57 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:57.929501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d107f32e-29b8-4b92-97a5-8b231b86a11d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54/action" status: 200 len: 32 microversion: 2.1 time: 0.483736 Jun 20 12:23:57.930777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 92/186] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:23:57 2022] POST /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:23:57.939759 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:57.940786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:57.947463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.948329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:57.949295 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:57.949914 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.207275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:58.220183 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-455e6c3f-68e4-4970-bb77-cc5ccbcee678 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.284425 Jun 20 12:23:58.220769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 95/187] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:57 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:58.428706 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-3fce2ab2-91e0-4c68-828d-38c26f3ba4d3 req-ab1d8b55-3274-482f-8105-cffe03089bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b954edf9-f964-4714-b270-e9f9ee51a80a", "tag": "cd7e676c-79aa-4b40-999b-85ed6d43f711"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:23:58.448718 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-3fce2ab2-91e0-4c68-828d-38c26f3ba4d3 req-ab1d8b55-3274-482f-8105-cffe03089bc8 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.449170 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-3fce2ab2-91e0-4c68-828d-38c26f3ba4d3 req-ab1d8b55-3274-482f-8105-cffe03089bc8 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.461183 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-3fce2ab2-91e0-4c68-828d-38c26f3ba4d3 req-ab1d8b55-3274-482f-8105-cffe03089bc8 service nova] Creating event network-changed:cd7e676c-79aa-4b40-999b-85ed6d43f711 for instance b954edf9-f964-4714-b270-e9f9ee51a80a on hv-cinder-83697 Jun 20 12:23:58.468815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-3fce2ab2-91e0-4c68-828d-38c26f3ba4d3 req-ab1d8b55-3274-482f-8105-cffe03089bc8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044152 Jun 20 12:23:58.470407 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 93/188] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:23:58.853209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:58.853838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:58.861291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.863932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:58.865551 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:58.866172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:59.042506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:59.051681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e85b48d8-fa03-4650-8f69-f49378a69c76 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1313 microversion: 2.1 time: 0.201720 Jun 20 12:23:59.055704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 96/189] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:58 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:23:59.237175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:23:59.238294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:23:59.248868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:59.249857 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:59.250831 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:23:59.251326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:23:59.565492 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:23:59.575134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8ea66cf2-943f-42c3-94a7-17448065084c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.342329 Jun 20 12:23:59.585246 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 94/190] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:23:59 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:00.069483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:00.072061 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:00.081204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.082873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.083886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.084520 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.285703 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:00.293909 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-04617a87-ae1c-4f14-a0a1-cadb8dee1ee6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1497 microversion: 2.1 time: 0.228988 Jun 20 12:24:00.294534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 97/191] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:00 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:00.592676 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:00.594644 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:00.602253 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.602717 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.603524 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:00.603958 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:00.745687 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:00.753921 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-54186b8c-cd8d-4ae9-98cf-acd09c7cf91b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.165325 Jun 20 12:24:00.757072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 95/192] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:00 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:01.607288 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:01.608536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:01.617260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:01.617943 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:01.618861 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:01.619675 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:01.652518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:24:01.772176 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:01.773351 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:01.784721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:01.785412 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:01.786276 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:01.786994 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:01.935076 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:01.945762 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3befc7bd-8dac-4a7f-bbe3-b435dfe8cdc9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.177798 Jun 20 12:24:01.947218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 96/193] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:01 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:02.027618 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6a40c7c2-a716-405c-b6be-ff3285aa5c05 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 204 len: 0 microversion: 2.1 time: 0.424737 Jun 20 12:24:02.028140 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 98/194] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:24:01 2022] DELETE /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:24:02.037139 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:02.037916 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:02.044493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.044959 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.045711 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.046163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.212512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:02.223500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-264c0ac4-ac5e-44d1-b751-6a3f430d6f6a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1503 microversion: 2.1 time: 0.190415 Jun 20 12:24:02.224925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 97/195] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:02 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:02.963578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:02.964275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:02.973559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.974205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:02.975149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:02.975739 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:03.116030 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:03.123711 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-537798db-8915-4e54-b739-ade0f44eccc2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.164376 Jun 20 12:24:03.124471 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 99/196] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:02 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:03.242682 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:03.243402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:03.249386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:03.249863 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:03.250612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:03.251043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:03.382817 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:03.390544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f18820db-d776-4053-a8c5-be9111896bf9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1503 microversion: 2.1 time: 0.152238 Jun 20 12:24:03.391105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 98/197] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:03 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:04.141070 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:04.141678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:04.149141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.149592 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.150506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.150995 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.287584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:04.295240 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ba9f9836-25e6-4628-9f20-e5f835cbc590 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.158194 Jun 20 12:24:04.295801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 100/198] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:04 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:04.408161 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:04.409341 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:04.415650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.423518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.423518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:04.423518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:04.555635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:04.563088 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e657d32e-2595-410b-a931-f40d657c73d1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1503 microversion: 2.1 time: 0.159385 Jun 20 12:24:04.563657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 99/199] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:04 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:05.311561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:05.312171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:05.319717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.322087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.322087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.322087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.580856 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:05.581868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:05.588587 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.589107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.589997 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:05.590671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:05.769153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:05.777340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8ebdc8ce-4ec6-45fc-b740-18dba04b9c41 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1503 microversion: 2.1 time: 0.200496 Jun 20 12:24:05.777927 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 100/200] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:05 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:05.845514 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:05.867997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-57793379-2ceb-4f21-b73a-c334bf20c87e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.560288 Jun 20 12:24:05.869044 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 101/201] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:05 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:06.292601 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-e535f539-8513-42aa-aa1f-eca77db168fe req-5eb9bd7a-7e78-45ae-8420-3aa7b9c9410c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86da428-35a0-45a5-86e4-ac5a197b5781", "name": "network-vif-deleted", "tag": "8c000653-6035-4513-850d-5081c6c0557f"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:06.301928 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-e535f539-8513-42aa-aa1f-eca77db168fe req-5eb9bd7a-7e78-45ae-8420-3aa7b9c9410c service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.303358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-e535f539-8513-42aa-aa1f-eca77db168fe req-5eb9bd7a-7e78-45ae-8420-3aa7b9c9410c service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.315034 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-e535f539-8513-42aa-aa1f-eca77db168fe req-5eb9bd7a-7e78-45ae-8420-3aa7b9c9410c service nova] Creating event network-vif-deleted:8c000653-6035-4513-850d-5081c6c0557f for instance d86da428-35a0-45a5-86e4-ac5a197b5781 on hv-cinder-83697 Jun 20 12:24:06.325488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-e535f539-8513-42aa-aa1f-eca77db168fe req-5eb9bd7a-7e78-45ae-8420-3aa7b9c9410c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032961 Jun 20 12:24:06.325488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 101/202] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:06.796009 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:06.797200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:06.804187 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.812521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.812521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.812521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.841070 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.841527 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.842020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lazy-loading 'fault' on Instance uuid d86da428-35a0-45a5-86e4-ac5a197b5781 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:24:06.885652 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:06.886447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:06.893127 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.893576 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.894397 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:06.894846 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:06.902977 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:06.912628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3ff4874e-2d86-4cf6-9ddb-5e4da800c0d9 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 200 len: 1303 microversion: 2.1 time: 0.120600 Jun 20 12:24:06.914508 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 102/203] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:06 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:07.045302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:07.053865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3e07909a-7d9a-439c-a183-92fb7ad65a0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.172374 Jun 20 12:24:07.054375 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 102/204] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:06 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:07.357072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:07.357571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:07.364588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.365142 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.365933 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.366619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.402545 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:24:07.768691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fe35003e-e369-4b2e-ad5d-390327ecf599 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 204 len: 0 microversion: 2.1 time: 0.415303 Jun 20 12:24:07.769627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 103/205] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:24:07 2022] DELETE /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:24:07.778567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:07.779467 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:07.786375 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.786965 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.787816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.788326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.933166 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:07.934751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: d86da428-35a0-45a5-86e4-ac5a197b5781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:07.944377 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.945027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.946234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:07.946866 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:07.949455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:07.958681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-45754f1c-6d84-4720-93d4-fbaae85de467 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1553 microversion: 2.1 time: 0.184221 Jun 20 12:24:07.968046 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 103/206] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:07 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:07.974327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] HTTP exception thrown: Instance d86da428-35a0-45a5-86e4-ac5a197b5781 could not be found. Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Request method failure captured: Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 HTTP/1.1 Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGbCXs7KTxBNHYL_HHurHxmU4hjxT7DubV1vV7cE_SJoONE2kaJiqNBaksyq1v1Lz3uN_YhRztlCIkhEjBl8r2csNs8fqmPGblPqL67QoGdULFS3WL2Xmuu2hkbwHoN9slZHJXod153_AXDL-hl_DQy-QLNSLYVn_h1Yt5Q_ggBYpC8 Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: f91f86e458674558b7b62cdd9e945eae Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesActionsTest-267143564 Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:24:07.979428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f91f86e458674558b7b62cdd9e945eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f91f86e458674558b7b62cdd9e945eae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f91f86e458674558b7b62cdd9e945eae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f91f86e458674558b7b62cdd9e945eae"}]}] Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesActionsTest-267143564 Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: f91f86e458674558b7b62cdd9e945eae Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesActionsTest-267143564 Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesActionsTest-267143564-project Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 14654ec95611472da8f89705599da7db Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesActionsTest-267143564-project Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance d86da428-35a0-45a5-86e4-ac5a197b5781 could not be found. Jun 20 12:24:07.980873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'd86da428-35a0-45a5-86e4-ac5a197b5781'} Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86da428-35a0-45a5-86e4-ac5a197b5781 could not be found. Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:07.981834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86da428-35a0-45a5-86e4-ac5a197b5781 could not be found. Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86da428-35a0-45a5-86e4-ac5a197b5781 could not be found. Jun 20 12:24:07.983400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:07.985261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Returning 404 to user: Instance d86da428-35a0-45a5-86e4-ac5a197b5781 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:07.986169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-427aa72d-6b1d-4e7b-b63e-80069b5fed1b tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781" status: 404 len: 111 microversion: 2.1 time: 0.058661 Jun 20 12:24:07.986678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 104/207] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:07 2022] GET /compute/v2.1/servers/d86da428-35a0-45a5-86e4-ac5a197b5781 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:08.072171 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:08.073172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:08.079827 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.080374 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.081456 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.081919 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.123036 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1038551957", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "networks": [{"uuid": "89eaf5ff-cfa0-4bc1-b1fb-2999f907b8cf"}]}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:08.178430 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] validate_networks() for [('89eaf5ff-cfa0-4bc1-b1fb-2999f907b8cf', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:24:08.260845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:08.272212 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ade46ade-d55c-4fff-9cdf-9414eafe0729 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.203822 Jun 20 12:24:08.272817 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 104/208] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:08 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:08.579723 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:24:08.580143 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:24:08.580615 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:24:08.581020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:24:08.581456 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:24:08.590838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.591298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.592109 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.592532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.609485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Getting quotas for project f91f86e458674558b7b62cdd9e945eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:24:08.613411 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Getting quotas for user 14654ec95611472da8f89705599da7db and project f91f86e458674558b7b62cdd9e945eae. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:24:08.625723 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:24:08.627970 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:24:08.824053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-80111447-4720-4c63-9f63-5366aabc7d98 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705262 Jun 20 12:24:08.827283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 105/209] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:24:08.835460 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9cd28168-5b5c-4f22-abb9-76333f38dee7 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:08.836292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9cd28168-5b5c-4f22-abb9-76333f38dee7 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:08.915306 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9cd28168-5b5c-4f22-abb9-76333f38dee7 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:08.921500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9cd28168-5b5c-4f22-abb9-76333f38dee7 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1214 microversion: 2.1 time: 0.090444 Jun 20 12:24:08.922293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 105/210] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:08 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:08.976858 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:08.979536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:08.990751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.991333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:08.992212 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:08.992748 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.147035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:09.151430 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:09.156744 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6c6912df-5f57-452a-adb3-2836c19eaf74 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1553 microversion: 2.1 time: 0.184828 Jun 20 12:24:09.157361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 106/211] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:08 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:09.290357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:09.292633 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:09.300364 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.300953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.303214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.304133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.459677 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:09.467098 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0814c4c0-fd09-424f-a51d-d760492bae9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.181796 Jun 20 12:24:09.467658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 106/212] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:09 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:09.939488 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:09.940005 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:09.947930 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.948368 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:09.949141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:09.949580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.011776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:10.019133 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-47d5bd49-8d07-4965-b15c-88f5b19f84fa tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1218 microversion: 2.1 time: 0.083785 Jun 20 12:24:10.019709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 107/213] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:09 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:10.173504 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:10.174319 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:10.181134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:10.181584 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.182489 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:10.182936 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.361743 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:10.370442 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ed900fc5-96ef-4242-986f-f3bdec6c75aa tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1553 microversion: 2.1 time: 0.200728 Jun 20 12:24:10.371210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 107/214] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:10 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:10.484192 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:10.485072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:10.492045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:10.492494 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.493261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:10.493693 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:10.639625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:10.647734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-78f5fd6d-9807-43b1-a943-2bf68a143df9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.167907 Jun 20 12:24:10.648290 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 108/215] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:10 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:11.037522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:11.038176 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:11.044269 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.044708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.045468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.045924 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.111921 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:11.119483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d7a84d8c-6370-41ea-81f2-864786e8169e tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1218 microversion: 2.1 time: 0.087416 Jun 20 12:24:11.120056 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 108/216] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:11 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:11.388447 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:11.389044 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:11.398006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.398468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.399350 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.400046 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.540410 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:11.548809 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1e809385-215a-48f0-8b57-74096560f0ad tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1553 microversion: 2.1 time: 0.164746 Jun 20 12:24:11.549652 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 109/217] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:11 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:11.665363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:11.666166 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:11.672158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.672610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.673877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:11.674580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:11.811070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:11.822941 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d11f6a81-5bf6-409f-87d0-634395e6599c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.162417 Jun 20 12:24:11.823576 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 109/218] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:11 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:12.136312 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:12.136914 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:12.142892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:12.143331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:12.167022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:12.167022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:12.205538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:12.213045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5f1f8925-b83d-43dd-8dfd-6d43bf2f7931 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1210 microversion: 2.1 time: 0.080578 Jun 20 12:24:12.213616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 110/219] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:12 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:12.567278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:12.569362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:12.575721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:12.576171 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:12.577172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:12.577642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:12.728112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:12.738309 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-17d0e3fe-6cc6-4c48-bbbe-07883497c77f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1553 microversion: 2.1 time: 0.176298 Jun 20 12:24:12.747777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 110/220] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:12 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:12.839782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:12.840427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:12.846986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:12.847417 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:12.848728 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:12.849228 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.024033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-e45764d1-015c-4d9c-8494-317c60d32dfd req-0768c47d-7436-4ed5-8b48-37d2edbe7b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2c0d3f-5fbd-486e-98fa-9056dde04005", "name": "network-vif-deleted", "tag": "c053b7b1-6ef3-43e4-9697-4f9502b323cb"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:13.037608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-e45764d1-015c-4d9c-8494-317c60d32dfd req-0768c47d-7436-4ed5-8b48-37d2edbe7b43 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.038090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-e45764d1-015c-4d9c-8494-317c60d32dfd req-0768c47d-7436-4ed5-8b48-37d2edbe7b43 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.046518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:13.060282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-e45764d1-015c-4d9c-8494-317c60d32dfd req-0768c47d-7436-4ed5-8b48-37d2edbe7b43 service nova] Creating event network-vif-deleted:c053b7b1-6ef3-43e4-9697-4f9502b323cb for instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 on hv-cinder-83697 Jun 20 12:24:13.066693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-e45764d1-015c-4d9c-8494-317c60d32dfd req-0768c47d-7436-4ed5-8b48-37d2edbe7b43 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049589 Jun 20 12:24:13.067847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 111/221] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:13.148295 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:13.158318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a973b4b4-cb65-4d98-865c-2839674d17ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.322169 Jun 20 12:24:13.158560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 111/222] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:12 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:13.232140 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:13.233017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:13.253231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.253231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.253231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.253231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.321981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:13.329392 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1c592efe-82e9-4799-bd57-5dc72565832c tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1266 microversion: 2.1 time: 0.102367 Jun 20 12:24:13.330204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 112/223] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:13 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:13.756425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:13.756946 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:13.763723 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.764167 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.764935 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:13.765571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:13.853298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03102ea04c0e42b19576f1800f8cc6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3499b45946141ff9177a6f3bbf01d3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:13.866389 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f8fd7ff2-1751-41d1-8952-fb0a7e38d46f tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 200 len: 1345 microversion: 2.1 time: 0.114632 Jun 20 12:24:13.870755 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 112/224] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:13 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 1345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:14.176062 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:14.176870 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:14.183337 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.183832 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.184837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.185329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.322388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:14.329613 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-94f69873-cfb8-47d4-bc8d-fae562f7e68d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.158073 Jun 20 12:24:14.330203 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 113/225] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:14 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:14.346719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:14.347321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:14.353773 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.354257 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.355038 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.355500 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.556223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:14.564510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f3838ebf-a15d-4079-9f50-afa01075152d tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.221863 Jun 20 12:24:14.565085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 113/226] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:14 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:14.892769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:14.892769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:14.892769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.892769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.893191 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:14.893191 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:14.906334 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] HTTP exception thrown: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Request method failure captured: Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 HTTP/1.1 Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGaoGsb8GzSyRcFwqszdk3PCnoiWC8g8FU8qwYfWd3dY8tuY9AhzbrspvaBxqXdP1uJP5X16VjEygOaujEUnxY18O4WdelepwmGW0hHR-rGSM9TdOA0w7DHhe63XYqzWdG1beGJffBxVhAT3fViK7u3drototx0R0-tCnyU1jzrs7I0 Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:24:14.911772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}] Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 03102ea04c0e42b19576f1800f8cc6e9 Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:14.913164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '3b2c0d3f-5fbd-486e-98fa-9056dde04005'} Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:14.913897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:14.914993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:14.916226 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Returning 404 to user: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:14.916226 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-bc0626a6-0a22-4aa5-b65e-0a8a3a4ae546 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 404 len: 111 microversion: 2.1 time: 0.033639 Jun 20 12:24:14.916226 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 114/227] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:14 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:15.060340 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:15.062385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:15.075382 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.076026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.076980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.078361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.102359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] HTTP exception thrown: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Request method failure captured: Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005/os-volume_attachments HTTP/1.1 Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGaoGsb8GzSyRcFwqszdk3PCnoiWC8g8FU8qwYfWd3dY8tuY9AhzbrspvaBxqXdP1uJP5X16VjEygOaujEUnxY18O4WdelepwmGW0hHR-rGSM9TdOA0w7DHhe63XYqzWdG1beGJffBxVhAT3fViK7u3drototx0R0-tCnyU1jzrs7I0 Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:24:15.116549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}] Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 03102ea04c0e42b19576f1800f8cc6e9 Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:15.122961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'server_id': '3b2c0d3f-5fbd-486e-98fa-9056dde04005'} Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:15.123636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:15.125154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:15.126246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Returning 404 to user: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:15.126246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8c4678cf-01bc-421b-a3a3-104fd732e177 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063270 Jun 20 12:24:15.126246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 114/228] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:24:15 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:15.347994 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:15.348765 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:15.354998 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.355449 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.356215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.356649 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.450806 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-102fb147-9bc9-493c-aaca-8ed2b23785d4 req-b0b1dc0e-36da-4daf-bbee-5a37e859b494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bab1396-e056-4c33-96ff-f71bdda8de4b", "tag": "ee444c9a-97d3-419f-96d5-4fe4d5096e75"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:15.461600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-102fb147-9bc9-493c-aaca-8ed2b23785d4 req-b0b1dc0e-36da-4daf-bbee-5a37e859b494 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.462383 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-102fb147-9bc9-493c-aaca-8ed2b23785d4 req-b0b1dc0e-36da-4daf-bbee-5a37e859b494 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.477298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-102fb147-9bc9-493c-aaca-8ed2b23785d4 req-b0b1dc0e-36da-4daf-bbee-5a37e859b494 service nova] Creating event network-changed:ee444c9a-97d3-419f-96d5-4fe4d5096e75 for instance 1bab1396-e056-4c33-96ff-f71bdda8de4b on hv-cinder-83697 Jun 20 12:24:15.483422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-102fb147-9bc9-493c-aaca-8ed2b23785d4 req-b0b1dc0e-36da-4daf-bbee-5a37e859b494 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036127 Jun 20 12:24:15.484700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 115/229] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:15.525719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:15.536049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6e63c5e8-0925-4146-8aca-94ea9608432a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.191121 Jun 20 12:24:15.537365 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 115/230] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:15 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:15.588579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:15.589393 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:15.595968 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.596500 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.597524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:15.598217 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:15.826689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:15.835019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-dba6e771-127a-4a5f-9d9e-b79855c69445 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.250723 Jun 20 12:24:15.835983 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 116/231] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:15 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:16.552332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:16.552829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:16.559054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.559500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.560267 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.560699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.709135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:16.718643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e199d835-1e70-4c29-975e-4b5cf3f978a5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.170206 Jun 20 12:24:16.719213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 116/232] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:16 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:16.852501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:16.853117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:16.860338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.860795 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.861569 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.862045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.946344 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:16.946847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:16.953314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.954018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.954900 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.955456 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:16.972144 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] HTTP exception thrown: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Request method failure captured: Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: DELETE /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 HTTP/1.1 Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGaoGsb8GzSyRcFwqszdk3PCnoiWC8g8FU8qwYfWd3dY8tuY9AhzbrspvaBxqXdP1uJP5X16VjEygOaujEUnxY18O4WdelepwmGW0hHR-rGSM9TdOA0w7DHhe63XYqzWdG1beGJffBxVhAT3fViK7u3drototx0R0-tCnyU1jzrs7I0 Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:24:16.974048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}] Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 03102ea04c0e42b19576f1800f8cc6e9 Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:16.975523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '3b2c0d3f-5fbd-486e-98fa-9056dde04005'} Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:16.976346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:16.977631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:16.978963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Returning 404 to user: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:16.978963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-56ff2336-f13b-4567-a7f2-252458387492 tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 404 len: 111 microversion: 2.1 time: 0.035406 Jun 20 12:24:16.979645 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 117/233] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:24:16 2022] DELETE /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:16.992461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:16.993074 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] [instance: 3b2c0d3f-5fbd-486e-98fa-9056dde04005] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:16.999146 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:16.999578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:17.000353 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:17.000792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:17.015248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] HTTP exception thrown: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Request method failure captured: Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 HTTP/1.1 Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGaoGsb8GzSyRcFwqszdk3PCnoiWC8g8FU8qwYfWd3dY8tuY9AhzbrspvaBxqXdP1uJP5X16VjEygOaujEUnxY18O4WdelepwmGW0hHR-rGSM9TdOA0w7DHhe63XYqzWdG1beGJffBxVhAT3fViK7u3drototx0R0-tCnyU1jzrs7I0 Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:24:17.019612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a3499b45946141ff9177a6f3bbf01d3d"}]}] Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: a3499b45946141ff9177a6f3bbf01d3d Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-DeleteServersTestJSON-170918522 Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 03102ea04c0e42b19576f1800f8cc6e9 Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-DeleteServersTestJSON-170918522-project Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:17.021022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '3b2c0d3f-5fbd-486e-98fa-9056dde04005'} Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:17.021673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. Jun 20 12:24:17.022785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:24:17.023884 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] Returning 404 to user: Instance 3b2c0d3f-5fbd-486e-98fa-9056dde04005 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:17.023884 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-dc0dd5cb-5756-4d60-a2dd-767c6299c08a tempest-DeleteServersTestJSON-170918522 tempest-DeleteServersTestJSON-170918522-project] 10.222.0.64 "GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005" status: 404 len: 111 microversion: 2.1 time: 0.030186 Jun 20 12:24:17.023884 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 118/234] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:16 2022] GET /compute/v2.1/servers/3b2c0d3f-5fbd-486e-98fa-9056dde04005 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:17.073950 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:17.085905 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d31f73e8-7560-4ca0-840e-aa91e1599f35 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.237276 Jun 20 12:24:17.086493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 117/235] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:16 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:17.737412 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:17.739163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:17.742257 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=97 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:17.751707 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:17.752161 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:17.752951 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:17.753393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:18.053745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:18.061602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-998f6fa9-46b8-4e01-abcc-60558d94c450 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.328589 Jun 20 12:24:18.062194 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 119/236] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:17 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:18.102725 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:18.108130 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:18.118980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:18.119783 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:18.120729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:18.121609 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:18.319964 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:18.330374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-91de1299-e5d9-4449-afee-ff66d1940ac8 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.232120 Jun 20 12:24:18.334172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 118/237] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:18 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:19.083223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:19.083223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:19.083223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:19.092085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:19.092638 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:19.095271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:19.097438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:19.278152 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:19.293786 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-31f55abc-66c0-428d-adf3-75b539cbe231 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.217888 Jun 20 12:24:19.294633 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 120/238] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:19 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:19.353342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:19.354620 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:19.366397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:19.370042 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=6 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:19.372362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:19.374501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:19.375973 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:19.377705 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:19.618013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:19.635142 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-25547721-7b89-45f0-81ea-2c928ce8aaf1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.284831 Jun 20 12:24:19.637348 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 119/239] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:19 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:20.312543 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:20.313160 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:20.325769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:20.326253 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:20.327043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:20.327479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:20.563070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:20.571492 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9084d708-ae3b-4109-b3d2-2d9517c0ad3e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.263155 Jun 20 12:24:20.572651 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 121/240] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:20 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:20.653045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:20.653643 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:20.660619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:20.661108 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:20.661928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:20.665855 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:20.991875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:21.002256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d550d772-31f6-4dbb-8063-30d47d077684 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.353534 Jun 20 12:24:21.008672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 120/241] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:20 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:21.159050 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-d2100c77-7178-4848-95f9-d3a8474333d6 req-6afe4658-39fe-418e-ab42-769b36de184f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bab1396-e056-4c33-96ff-f71bdda8de4b", "name": "network-vif-plugged", "status": "completed", "tag": "ee444c9a-97d3-419f-96d5-4fe4d5096e75"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:21.168261 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-d2100c77-7178-4848-95f9-d3a8474333d6 req-6afe4658-39fe-418e-ab42-769b36de184f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:21.168791 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-d2100c77-7178-4848-95f9-d3a8474333d6 req-6afe4658-39fe-418e-ab42-769b36de184f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:21.182478 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-d2100c77-7178-4848-95f9-d3a8474333d6 req-6afe4658-39fe-418e-ab42-769b36de184f service nova] Creating event network-vif-plugged:ee444c9a-97d3-419f-96d5-4fe4d5096e75 for instance 1bab1396-e056-4c33-96ff-f71bdda8de4b on hv-cinder-83697 Jun 20 12:24:21.187773 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-d2100c77-7178-4848-95f9-d3a8474333d6 req-6afe4658-39fe-418e-ab42-769b36de184f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032896 Jun 20 12:24:21.188446 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 122/242] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:24:21.590956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:21.591869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:21.602375 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:21.603083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:21.609907 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:21.610583 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:21.992674 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:22.001073 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-411ad218-f167-4890-a8f6-237633a59d7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.415522 Jun 20 12:24:22.001782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 121/243] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:21 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:22.031098 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:22.032819 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:22.040691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:22.040879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:22.042237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:22.042676 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:22.220693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:22.228695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-684cb49a-6b28-477f-8d85-2d3238486173 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.206830 Jun 20 12:24:22.229413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 123/244] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:22 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:23.020074 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:23.021168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:23.027871 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:23.028314 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:23.029436 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:23.029727 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:23.206334 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:23.215518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fd7b9a39-4a55-4140-acbe-31a4231ffa2f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.200757 Jun 20 12:24:23.220464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 122/245] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:23 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:23.250085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:23.250085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:23.252318 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:23.252737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:23.253519 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:23.254524 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:23.436140 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:23.451239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f46f1925-80c6-4fec-a7bc-cbec6b6569e2 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1314 microversion: 2.1 time: 0.207813 Jun 20 12:24:23.453033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 124/246] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:23 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:24.232513 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:24.233110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:24.239849 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:24.240300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:24.241064 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:24.241673 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:24.382649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:24.393087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0301b10f-baf1-4f5b-8bd3-2fcb76604410 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.164364 Jun 20 12:24:24.393975 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 123/247] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:24 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:24.486837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:24.487515 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:24.494415 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:24.494871 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:24.495650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:24.496102 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:24.665507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:24.673382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9fe92e32-d59c-41eb-87cb-3a2fb0a111f6 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1497 microversion: 2.1 time: 0.190511 Jun 20 12:24:24.674295 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 125/248] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:24 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:25.418661 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:25.419204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:25.426479 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.427080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:25.427854 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.428288 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:25.566417 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:25.567198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:25.574008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.574715 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:25.577970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.577970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:25.602511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:24:25.612188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:25.617579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:25.622369 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-382ec68f-0da0-4e09-86d7-cc3d36732f37 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.210208 Jun 20 12:24:25.622962 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 124/249] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:25 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:25.954252 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-50265668-4f7d-4f3d-852a-6f9fce76da1a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 204 len: 0 microversion: 2.1 time: 0.388224 Jun 20 12:24:25.959812 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 126/250] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:24:25 2022] DELETE /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:24:25.969562 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:25.970200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:25.977982 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.978698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:25.979964 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:25.980875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:26.133278 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:26.142384 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-130be9b0-a8e8-4a10-b0fe-9602cd6a3c3f tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1503 microversion: 2.1 time: 0.177374 Jun 20 12:24:26.154427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 125/251] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:25 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:26.641481 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:26.642209 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:26.648591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:26.649172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:26.649977 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:26.650417 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:26.793831 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:26.802350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0fef99dc-4d69-494f-bcf7-30579e03f652 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.165484 Jun 20 12:24:26.803009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 127/252] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:26 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:27.160941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:27.161558 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:27.163890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:27.169054 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:27.169626 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:27.170441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:27.170882 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:27.413000 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:27.422390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6e15bda4-fe79-4746-85d6-6870e3b9ca7a tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1503 microversion: 2.1 time: 0.264010 Jun 20 12:24:27.424232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 126/253] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:27 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:27.820087 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:27.820712 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:27.826928 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:27.830368 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:27.831204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:27.832444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:28.029275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:28.038590 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4b18895a-3d0e-4c84-9e0c-02545927152e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.223288 Jun 20 12:24:28.040410 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 128/254] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:27 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:28.448909 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:28.449542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:28.453108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-6fa24d26-09de-4e12-a8da-88a66c778189 req-f2efab1c-8981-4864-8e8a-1bbe927452d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bab1396-e056-4c33-96ff-f71bdda8de4b", "name": "network-vif-deleted", "tag": "ee444c9a-97d3-419f-96d5-4fe4d5096e75"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:28.455603 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:28.456052 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:28.456888 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:28.457331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:28.463264 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-6fa24d26-09de-4e12-a8da-88a66c778189 req-f2efab1c-8981-4864-8e8a-1bbe927452d2 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:28.464004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-6fa24d26-09de-4e12-a8da-88a66c778189 req-f2efab1c-8981-4864-8e8a-1bbe927452d2 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:28.480113 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-6fa24d26-09de-4e12-a8da-88a66c778189 req-f2efab1c-8981-4864-8e8a-1bbe927452d2 service nova] Creating event network-vif-deleted:ee444c9a-97d3-419f-96d5-4fe4d5096e75 for instance 1bab1396-e056-4c33-96ff-f71bdda8de4b on hv-cinder-83697 Jun 20 12:24:28.485515 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-6fa24d26-09de-4e12-a8da-88a66c778189 req-f2efab1c-8981-4864-8e8a-1bbe927452d2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045994 Jun 20 12:24:28.486998 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 129/255] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:28.537186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14654ec95611472da8f89705599da7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91f86e458674558b7b62cdd9e945eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:28.546782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bdff654e-63e2-4342-b922-983f12e8abe1 tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 200 len: 1461 microversion: 2.1 time: 0.108006 Jun 20 12:24:28.546782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 127/256] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:28 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 1461 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:29.056108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:29.057005 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:29.064054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:29.064563 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:29.065410 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:29.066669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:29.072387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:29.208695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:29.216068 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7f4c121b-d4fb-4197-862c-3928c4add9b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.164205 Jun 20 12:24:29.216665 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 130/257] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:29 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:29.562954 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:29.563583 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] [instance: 1bab1396-e056-4c33-96ff-f71bdda8de4b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:29.571577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:29.572223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:29.573083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:29.573522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:29.587434 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] HTTP exception thrown: Instance 1bab1396-e056-4c33-96ff-f71bdda8de4b could not be found. Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Request method failure captured: Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b HTTP/1.1 Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGbCXs7KTxBNHYL_HHurHxmU4hjxT7DubV1vV7cE_SJoONE2kaJiqNBaksyq1v1Lz3uN_YhRztlCIkhEjBl8r2csNs8fqmPGblPqL67QoGdULFS3WL2Xmuu2hkbwHoN9slZHJXod153_AXDL-hl_DQy-QLNSLYVn_h1Yt5Q_ggBYpC8 Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: f91f86e458674558b7b62cdd9e945eae Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesActionsTest-267143564 Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:24:29.589110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f91f86e458674558b7b62cdd9e945eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f91f86e458674558b7b62cdd9e945eae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f91f86e458674558b7b62cdd9e945eae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f91f86e458674558b7b62cdd9e945eae"}]}] Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesActionsTest-267143564 Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: f91f86e458674558b7b62cdd9e945eae Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesActionsTest-267143564 Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesActionsTest-267143564-project Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 14654ec95611472da8f89705599da7db Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesActionsTest-267143564-project Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 1bab1396-e056-4c33-96ff-f71bdda8de4b could not be found. Jun 20 12:24:29.590623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '1bab1396-e056-4c33-96ff-f71bdda8de4b'} Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bab1396-e056-4c33-96ff-f71bdda8de4b could not be found. Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:24:29.591533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bab1396-e056-4c33-96ff-f71bdda8de4b could not be found. Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bab1396-e056-4c33-96ff-f71bdda8de4b could not be found. Jun 20 12:24:29.592894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:24:29.594100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] Returning 404 to user: Instance 1bab1396-e056-4c33-96ff-f71bdda8de4b could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:24:29.594100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2fa1b19b-5cb8-41c7-9f03-609da39ddfad tempest-VolumesActionsTest-267143564 tempest-VolumesActionsTest-267143564-project] 10.222.0.64 "GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b" status: 404 len: 111 microversion: 2.1 time: 0.031779 Jun 20 12:24:29.594100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 128/258] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:29 2022] GET /compute/v2.1/servers/1bab1396-e056-4c33-96ff-f71bdda8de4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:30.233542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:30.234245 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:30.241837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:30.242307 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:30.243088 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:30.243525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:30.385105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:30.395783 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-70fd4c64-8130-4d76-8e22-5d86324e2939 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.166140 Jun 20 12:24:30.396461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 131/259] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:30 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:31.420128 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:31.422223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:31.433321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:31.434300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:31.435542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:31.436327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:31.595362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:31.604175 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4ef1e4f0-5dcd-40d7-bf0c-0cde95840993 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.195270 Jun 20 12:24:31.604736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 129/260] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:31 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:32.620871 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:32.622350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:32.630958 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.631495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.632559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:32.633003 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:32.929817 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:32.947180 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ce4ba531-9873-4f29-a4f4-4fbeeacbfad4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.330253 Jun 20 12:24:32.948031 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 132/261] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:32 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:33.964654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:33.965337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:33.972188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:33.973339 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:33.974134 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:33.977560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:34.149104 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:34.157088 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-845217cd-8603-453e-9eea-e06b68a5fc03 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.196508 Jun 20 12:24:34.157758 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 130/262] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:33 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:35.174650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:35.175382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:35.185657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:35.186461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:35.187891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:35.188638 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:35.384664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:35.405210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b94c273c-4fb3-4e4f-a05d-3eacba88ae1f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.235084 Jun 20 12:24:35.405653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 133/263] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:35 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:36.429793 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:36.431579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:36.607408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:36.607408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:36.607408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:36.607408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:36.608894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:36.623543 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f68e52a8-cac4-4496-a7c3-ea279352848d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1521 microversion: 2.1 time: 0.198699 Jun 20 12:24:36.624754 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 131/264] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:36 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:37.642199 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:37.642798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:37.658043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.658043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:37.661335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.664172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:37.806419 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:37.814138 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3da47af3-ec9b-4933-a702-96ccc9158c83 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1501 microversion: 2.1 time: 0.176719 Jun 20 12:24:37.814703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 134/265] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:37 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:37.835081 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:37.835807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:37.844586 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.845376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:37.846719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:37.847361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:38.007015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:38.015240 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4f5e25f8-211f-47fb-a480-5e1bcd97e0c4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1515 microversion: 2.1 time: 0.184813 Jun 20 12:24:38.015816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 132/266] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:37 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:40.853530 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b2c8eccc-7f99-4e9c-9afb-d294206705fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:40.854109 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b2c8eccc-7f99-4e9c-9afb-d294206705fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:40.860218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c8eccc-7f99-4e9c-9afb-d294206705fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.860671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c8eccc-7f99-4e9c-9afb-d294206705fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:40.861466 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c8eccc-7f99-4e9c-9afb-d294206705fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:40.861937 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c8eccc-7f99-4e9c-9afb-d294206705fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:40.885190 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b2c8eccc-7f99-4e9c-9afb-d294206705fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/ips" status: 200 len: 145 microversion: 2.1 time: 0.036006 Jun 20 12:24:40.885753 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 135/267] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:24:40 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:42.003580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:42.004670 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:42.012204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.016753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.016753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.016753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.038349 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lazy-loading 'flavor' on Instance uuid 108e8e51-7234-4ddc-9ff6-6e2bfed530ff {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:24:42.385522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-70b830bf-8383-4237-9142-04ba48bb47a7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff/action" status: 200 len: 32 microversion: 2.1 time: 0.385913 Jun 20 12:24:42.386492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 133/268] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:24:41 2022] POST /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff/action => generated 32 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:24:42.400578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:42.401361 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:42.409314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.409904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.411085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:42.411533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:42.599773 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:42.621854 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ef1b539f-0f38-4981-b3c5-41952ab05f52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.228898 Jun 20 12:24:42.622387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 136/269] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:42 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:43.648339 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:43.649263 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:43.660852 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:43.661485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:43.663003 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:43.663876 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:44.002079 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:44.011961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1c2eab3c-8b69-4dd9-b6b7-eddc36344846 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.375794 Jun 20 12:24:44.013987 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 134/270] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:43 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:45.033409 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:45.034054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:45.040651 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:45.041107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:45.041913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:45.042349 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:45.182928 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:45.190493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a2b54932-7bb5-4ca9-b2df-e1203e561f21 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.160898 Jun 20 12:24:45.191297 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 137/271] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:45 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:46.210190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:46.210720 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:46.217226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.217787 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.218615 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:46.219040 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:46.347009 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:46.355246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-25c43fe3-da6a-4f9e-afed-42504e3d2e33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.149731 Jun 20 12:24:46.355806 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 135/272] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:46 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:47.372339 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:47.372984 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:47.379049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:47.379499 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:47.380343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:47.381362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:47.509086 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:47.516439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7e538759-7d58-4f62-af7e-0cc2d29c67cf tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.148099 Jun 20 12:24:47.516999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 138/273] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:47 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:48.537642 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:48.538398 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:48.545304 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.548559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.548559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.548559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.752967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:48.764050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ba47391e-92b4-418b-bd74-78efba706c95 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.232611 Jun 20 12:24:48.766409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 136/274] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:48 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:48.941608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9cb49efe-9700-47ed-a32a-b82baaf491f7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f34d5cbc-0636-4257-b763-d92ac616a928"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:48.948908 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9cb49efe-9700-47ed-a32a-b82baaf491f7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:48.959969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:48.963255 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cb49efe-9700-47ed-a32a-b82baaf491f7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.963902 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cb49efe-9700-47ed-a32a-b82baaf491f7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:48.964898 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cb49efe-9700-47ed-a32a-b82baaf491f7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:48.965510 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cb49efe-9700-47ed-a32a-b82baaf491f7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:49.783298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:49.783899 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:49.790741 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:49.791164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:49.791920 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:49.792364 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:49.929965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:49.938890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c3ee29cf-3dab-4fb8-bef4-1af5c4e8e4f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.159396 Jun 20 12:24:49.939993 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 137/275] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:49 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:50.140331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9cb49efe-9700-47ed-a32a-b82baaf491f7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.204062 Jun 20 12:24:50.141319 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 139/276] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:24:48 2022] POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:50.958421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:50.959865 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:50.969043 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:50.969828 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:50.970885 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:50.971559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:51.146774 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:51.158000 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-68af549a-a671-4c72-8156-2a6dc653119c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.203409 Jun 20 12:24:51.158915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 138/277] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:50 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:52.181360 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:52.182109 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:52.189437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:52.189934 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:52.190781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:52.191226 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:52.330890 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:52.339344 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5e99e258-2477-45f3-9973-ed851ec04bf4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.163826 Jun 20 12:24:52.340014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 140/278] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:52 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:53.070701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-70b61e9e-cd74-4032-b682-23adecf9cb01 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:53.070701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-70b61e9e-cd74-4032-b682-23adecf9cb01 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:53.081011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b61e9e-cd74-4032-b682-23adecf9cb01 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.081847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b61e9e-cd74-4032-b682-23adecf9cb01 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.082976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b61e9e-cd74-4032-b682-23adecf9cb01 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.083743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-70b61e9e-cd74-4032-b682-23adecf9cb01 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.126042 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-70b61e9e-cd74-4032-b682-23adecf9cb01 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/ips" status: 200 len: 150 microversion: 2.1 time: 0.058067 Jun 20 12:24:53.126042 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 139/279] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:24:53 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:53.358414 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:53.359670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:53.366205 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.366963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.368471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:53.368909 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:53.520772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:53.530544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d8103186-1e3a-4887-8f51-407cbe69435b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.177166 Jun 20 12:24:53.541018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 141/280] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:53 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:54.548474 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:54.549204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:54.556746 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:54.557193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:54.557989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:54.558523 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:54.576816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:54.705754 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:54.717523 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-702ae297-b35c-4ff8-96f9-49a65cc77f24 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.171893 Jun 20 12:24:54.718468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 140/281] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:54 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:55.762055 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:55.764101 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:55.775835 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.776807 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.777754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:55.778666 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:55.981918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:56.003514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6b9b3ecf-2163-4df6-8ee2-46c40ae55511 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.271619 Jun 20 12:24:56.007496 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 142/282] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:55 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:56.033326 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0b77efa5-f1a4-4863-b763-8b07f00ac579 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "055d6866-4537-4c50-9dae-83c791ba97f1"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:56.035063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0b77efa5-f1a4-4863-b763-8b07f00ac579 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:56.045738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0b77efa5-f1a4-4863-b763-8b07f00ac579 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:56.046726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0b77efa5-f1a4-4863-b763-8b07f00ac579 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:56.053836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0b77efa5-f1a4-4863-b763-8b07f00ac579 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:56.055761 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0b77efa5-f1a4-4863-b763-8b07f00ac579 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:57.026890 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:57.027492 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:57.034413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:57.035088 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:57.036070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:57.043034 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:57.288509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:57.303273 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2983871d-e154-460e-a88e-498d66f53e40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.281258 Jun 20 12:24:57.304176 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 143/283] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:57 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:57.379388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0b77efa5-f1a4-4863-b763-8b07f00ac579 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.356512 Jun 20 12:24:57.386796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 141/284] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:24:56 2022] POST /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments => generated 194 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:24:58.053315 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9c6787c6-1daa-49a0-917f-a12eea69cbf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:24:58.081771 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9c6787c6-1daa-49a0-917f-a12eea69cbf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.082939 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9c6787c6-1daa-49a0-917f-a12eea69cbf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.297084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9c6787c6-1daa-49a0-917f-a12eea69cbf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Going to try to stop instance {{(pid=118091) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:24:58.323016 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:58.323758 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:58.338883 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.340782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.341707 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.343388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.456154 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:58.560516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9c6787c6-1daa-49a0-917f-a12eea69cbf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action" status: 202 len: 0 microversion: 2.1 time: 0.511132 Jun 20 12:24:58.564905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 144/285] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:24:58 2022] POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:24:58.571323 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:58.572381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:58.581460 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.581460 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.582307 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:58.583815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:58.736290 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:58.750518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-105297ca-4282-4b6c-9d50-19f2cb781629 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.433732 Jun 20 12:24:58.754847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 142/286] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:58 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:24:58.830690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:24:58.845602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a99032e5-0b7a-4740-8479-cf487cc331ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.279014 Jun 20 12:24:58.846736 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 145/287] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:58 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:24:59.774069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:59.778019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:59.794779 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.795575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:59.796600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.797243 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:59.865104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:24:59.866014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:24:59.879798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.880557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:24:59.881415 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:24:59.884282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:00.122550 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:00.134953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-25080d21-5131-4824-a235-56bb89a74e22 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.273663 Jun 20 12:25:00.135524 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 146/288] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:59 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:00.191608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:00.200439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5a0f8e41-ed11-4d47-96e2-674dc85e2e34 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.432856 Jun 20 12:25:00.201358 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 143/289] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:24:59 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:01.153750 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:01.154895 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:01.165016 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.170514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.170514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.170514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.217992 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:01.223440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:01.224815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.225260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.226072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:01.226560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:01.370841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:01.391037 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cb4b8e40-076f-4ac3-af9d-51d9bf6ef35c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.241154 Jun 20 12:25:01.394230 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 147/290] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:01 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:01.399039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:01.407404 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-cebc43e1-aa5c-4b1f-9102-6d148a678ce6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.193109 Jun 20 12:25:01.408259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 144/291] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:01 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:02.408702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:02.411612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:02.426838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:02.427659 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:02.435194 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:02.435722 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.441024 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:02.441516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.442593 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=38 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:02.449595 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:02.451252 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.466918 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:02.467228 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:02.832418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:02.862815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-abf542c4-7c24-43cf-92ae-ca84e11beee6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.442002 Jun 20 12:25:02.865382 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 145/292] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:02 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:02.976659 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:02.990358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-85e188b5-c69c-48cb-87fd-4cf6bc5e00d2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.585772 Jun 20 12:25:02.990949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 148/293] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:02 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:03.880153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:03.881096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:03.891737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:03.892271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:03.893022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:03.893427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.010664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:04.011359 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:04.023507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.031701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.031701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:04.031701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:04.207416 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:04.243156 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6bc65322-a08e-445c-9375-aee518c8673d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.352179 Jun 20 12:25:04.244443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 146/294] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:03 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:04.394436 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:04.404763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ea950739-48fd-420b-aa44-4cc5563c570f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.400027 Jun 20 12:25:04.428365 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 149/295] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:04 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:05.264255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:05.264955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:05.275735 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:05.281381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:05.281381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:05.281381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:05.424979 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:05.426153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:05.451107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:05.451567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:05.452347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:05.458493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:05.491200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:05.503363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-87e98641-c116-4f64-b0ce-dea4bb327475 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.246010 Jun 20 12:25:05.506760 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 147/296] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:05 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:05.774393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:05.785544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ede2e149-0313-4f4e-ade4-481db460b1ba tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.364841 Jun 20 12:25:05.790936 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 150/297] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:05 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:06.524091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:06.524748 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:06.533739 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.534208 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.535009 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.535664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.806084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:06.806893 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:06.817905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.826552 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.831062 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:06.831560 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:06.943433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:06.955911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2d3f4193-6ccd-4334-b6ea-ea29ff5915de tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.436241 Jun 20 12:25:06.957423 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 148/298] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:06 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:07.421362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:07.431925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-938afc3f-10bd-4ec6-9861-4d391025751a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.630175 Jun 20 12:25:07.433205 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 151/299] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:06 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:07.978736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:07.979608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:07.998358 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:07.999424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.003008 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.004103 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.450671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:08.451996 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:08.472583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.472583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.472583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:08.472583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:08.959281 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:08.975592 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d894c8f2-48cf-4cc4-aaf3-95d928c1dbee tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.529062 Jun 20 12:25:08.977233 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 152/300] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:08 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:09.068561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:09.088303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8af69450-bf6f-473c-a694-e64b28532445 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 1.117647 Jun 20 12:25:09.089153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 149/301] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:07 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:09.996456 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:09.997013 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:10.019023 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.031358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.031358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.031358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.106568 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:10.108960 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:10.122973 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.125235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.129528 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:10.151873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:10.397130 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:10.432753 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-61efca67-2d61-47e5-8a13-126d34c4fdc0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.441775 Jun 20 12:25:10.439070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 153/302] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:09 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:10.513222 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-aac7985d-2483-41ce-a02c-1e9697824325 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: .version_select at 0x7fe29029a310>, body: {"keypair": {"name": "tempest-keypair-1315440575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKLxbIFWyLAiNHiBfDPeH2UkJFTO2JObFFctEPyUr6ISvxCeW7KrsXCN20KdJdRNj8xt0TTsaqtJqmYI0EqH+R9+Apyp8hujyQ5vJBv+CElDYM7JIAaTQkSSIfEdhWmsA=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:10.550703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-aac7985d-2483-41ce-a02c-1e9697824325 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:10.564815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-aac7985d-2483-41ce-a02c-1e9697824325 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:10.616400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:10.637245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-495e2a0c-0a3a-44ff-86b4-e53d68bfc56f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.522430 Jun 20 12:25:10.637245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 150/303] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:10 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:10.678809 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-aac7985d-2483-41ce-a02c-1e9697824325 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169033 Jun 20 12:25:10.679752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 154/304] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:25:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:11.453440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:11.454078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:11.464593 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:11.468790 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:11.468790 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:11.468790 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:11.646085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:11.646085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:11.655517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:11.665911 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:11.666832 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:11.668633 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:11.821691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:11.832713 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-af2420c1-7567-49e3-b6c3-d82c8a5a7c8e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.383122 Jun 20 12:25:11.838224 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 151/305] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:11 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:12.086312 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:12.097966 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-89079782-a0e6-4c7c-98eb-1d38d691be0c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.457344 Jun 20 12:25:12.100695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 155/306] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:11 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:12.857172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:12.858072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:12.870854 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.872285 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:12.876266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:12.876380 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.120690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:13.123262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:13.147794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.156046 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.158289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:13.161249 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:13.400796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:13.421997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e029f8d0-8083-44aa-93e1-1d26a0656df8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.570586 Jun 20 12:25:13.425864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 152/307] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:12 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:13.503498 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:13.528331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a1c0fe5f-c51f-469a-a3ff-482a7f405b89 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.403049 Jun 20 12:25:13.538173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 156/308] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:13 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:14.440796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:14.442509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:14.450694 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:14.451380 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:14.452872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:14.453866 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:14.548354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:14.548789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:14.571218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:14.581175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:14.585657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:14.587525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:14.705336 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:14.725582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9193c0c3-5ea9-4ec8-bef4-fc5ea8e751e8 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.288810 Jun 20 12:25:14.727321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 153/309] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:14 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:14.931554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-229540947", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ad919b-444d-4364-9171-7dcb6a499f3f"}], "security_groups": [{"name": "tempest-securitygroup--937265947"}], "key_name": "tempest-keypair-1315440575", "user_data": "}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:15.042184 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:15.051210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-df7a1a56-7012-4a7d-bee2-e2a799e791b8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.509020 Jun 20 12:25:15.062869 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 157/310] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:14 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:15.226459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] validate_networks() for [('25ad919b-444d-4364-9171-7dcb6a499f3f', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:25:15.982922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:15.984096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:15.984726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:15.985305 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:15.986203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:16.001525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.011348 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4d13868c-bcc7-4419-ae04-bfbe7f8dd19a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Action: 'create', calling method: .version_select at 0x7fe29034e310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1801647061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqbUmfaqIQGDOmuYlEVXvMdeH/Z9rLMEVFboPuHJ6a+8CW33ZoqA97t8owopgoVfZpGkScmgOTHpY0H3DeujMMMhW/R02m5jkqMNyZcv83RWaYuEWq4RBEBeuFrUob1hA=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:16.016977 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.029234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.034306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.058283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-4d13868c-bcc7-4419-ae04-bfbe7f8dd19a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Getting quotas for project ae372a6537684625acb82b36862bde25. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:16.084684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-4d13868c-bcc7-4419-ae04-bfbe7f8dd19a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Getting quotas for user 85d4be423d794100ac5b00d32fb5620c and project ae372a6537684625acb82b36862bde25. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:16.089028 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:16.094049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:16.107857 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:25:16.110199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:25:16.232316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4d13868c-bcc7-4419-ae04-bfbe7f8dd19a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.793000 Jun 20 12:25:16.232846 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 158/311] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:25:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:25:16.237739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:16.238380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:16.266107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.266107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.268711 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.269488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.295895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-eb00012f-1a0c-414a-8cd1-20ecff428d4e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.368873 Jun 20 12:25:16.299141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 154/312] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:25:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:25:16.305730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:16.306388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:16.323064 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.324688 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.325529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:16.327421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:16.512146 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:16.536807 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-35bbfba8-e975-48cb-825c-6825fda60945 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1722 microversion: 2.1 time: 0.302587 Jun 20 12:25:16.543520 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 159/313] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:16 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:16.549753 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ba11aed6-41e0-46a8-9141-f9e75771624a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:16.553174 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ba11aed6-41e0-46a8-9141-f9e75771624a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:16.719393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ba11aed6-41e0-46a8-9141-f9e75771624a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:16.725658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:16.732932 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ba11aed6-41e0-46a8-9141-f9e75771624a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1241 microversion: 2.1 time: 0.188192 Jun 20 12:25:16.736135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 160/314] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:16 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1241 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:16.740780 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2748f65a-8b59-4ee3-9e94-07256310bca8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.440550 Jun 20 12:25:16.746779 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 155/315] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:16 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:17.555597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:17.556220 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:17.562297 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.562756 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.563528 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.563962 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.759534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:17.763140 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:17.786202 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.786914 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.789566 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:17.789716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.789716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.800868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-92c38800-fbf6-43d2-9996-428215a8ef80 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1699 microversion: 2.1 time: 0.247061 Jun 20 12:25:17.801480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 161/316] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:17 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1699 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:17.812644 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:17.814052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:17.825667 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.826161 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.826989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:17.827484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:17.848923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:17.945824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:17.971149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8db6e50a-1410-4b36-8d7c-9babe2a66f2e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1245 microversion: 2.1 time: 0.222933 Jun 20 12:25:17.972198 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 156/317] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:17 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1245 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:17.996842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7296e0ea-0050-424d-86b9-def249c9c257 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:18.030171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7296e0ea-0050-424d-86b9-def249c9c257 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:18.030718 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7296e0ea-0050-424d-86b9-def249c9c257 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:18.211671 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7296e0ea-0050-424d-86b9-def249c9c257 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Going to try to start instance {{(pid=118092) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:25:18.213147 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:18.224086 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3fb088d0-f59a-4a2a-b70b-af467dc09834 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.421342 Jun 20 12:25:18.224961 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 162/318] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:17 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:18.509838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7296e0ea-0050-424d-86b9-def249c9c257 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action" status: 202 len: 0 microversion: 2.1 time: 0.520548 Jun 20 12:25:18.510898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 157/319] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:17 2022] POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:25:18.518564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:18.519178 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:18.525503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:18.526188 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:18.527371 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:18.527963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:18.720916 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:18.730610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1e81db45-7e1b-45f4-92da-08a16610bbb2 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1708 microversion: 2.1 time: 0.215823 Jun 20 12:25:18.731300 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 163/320] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:18 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1708 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:18.992855 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:18.993566 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:19.010424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.011225 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.011895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.012339 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.250708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:19.251403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:19.275528 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:19.279507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.279916 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.280715 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.281168 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.302714 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:19.313731 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b0a1e5e4-a870-498a-806a-c87d313a32e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1293 microversion: 2.1 time: 0.327003 Jun 20 12:25:19.316440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 158/321] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:18 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1293 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:19.343880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:19.512139 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:19.525041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b9cdfef6-0f4f-4da0-8f3e-954aed417412 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.285997 Jun 20 12:25:19.526047 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 164/322] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:19 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:19.752187 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:19.752952 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:19.769180 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.769630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:19.770436 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:19.770872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.014420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:20.032269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6a585ba7-583e-4bf6-8a57-3c4887362358 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1708 microversion: 2.1 time: 0.284979 Jun 20 12:25:20.033528 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 159/323] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:19 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1708 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:20.335059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:20.337245 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:20.346580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.346580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.346580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.346580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.508622 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:20.518012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-84cc09e3-57f8-47b3-90f7-fed83033bfd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1311 microversion: 2.1 time: 0.186818 Jun 20 12:25:20.520776 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 165/324] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:20 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1311 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:20.546072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:20.547021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:20.554752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.556694 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.557888 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:20.558674 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:20.765398 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:20.774602 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-876f935f-7fd3-46a9-b1e0-d3fe152f46d4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.233753 Jun 20 12:25:20.775180 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 160/325] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:20 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:21.051318 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:21.052155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:21.060874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.060874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.060874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.060874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.229138 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:21.238394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b2c991e7-cb4e-42aa-93e8-5ae2ad94484b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1708 microversion: 2.1 time: 0.191115 Jun 20 12:25:21.250036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 166/326] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:21 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1708 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:21.543526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:21.543526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:21.546825 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.547266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.548243 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.548949 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.621702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:21.629577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a47afaae-73e3-48d7-b34b-b6516b22e965 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1311 microversion: 2.1 time: 0.095593 Jun 20 12:25:21.630181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 161/327] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:21 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:21.793454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:21.794976 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:21.801604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.802080 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:21.803202 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:21.803802 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.262406 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:22.262891 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:22.270763 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:22.271256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.272352 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:22.272886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.313856 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:22.323866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d48117a7-45aa-4668-9977-fc469fdc7759 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.535243 Jun 20 12:25:22.324870 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 167/328] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:21 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:22.435321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:22.444329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-43d2a5f6-2a8f-4179-bee6-cc0e576a3acc tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1708 microversion: 2.1 time: 0.189914 Jun 20 12:25:22.444951 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 162/329] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:22 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1708 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:22.652669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:22.653498 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:22.665176 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:22.665899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.668257 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:22.668257 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:22.781545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:22.801200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-002495b2-bf79-4d44-917d-d68cc2682033 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1299 microversion: 2.1 time: 0.150987 Jun 20 12:25:22.802756 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 168/330] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:22 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1299 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:23.342070 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:23.343638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:23.372168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.375663 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.397230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.397230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.465187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:23.466096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:23.473749 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.474376 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.475317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.476112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.737883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:23.761163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d5b050ee-160f-49c1-ad8c-675eba0adb70 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1708 microversion: 2.1 time: 0.296484 Jun 20 12:25:23.761163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 169/331] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:23 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1708 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:23.818273 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:23.821404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:23.822234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:23.830745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.831237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.832082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:23.832621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:23.833101 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d69c7451-d41e-4208-b423-63a4d9d1c637 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.495520 Jun 20 12:25:23.837842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 163/332] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:23 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:24.015421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:24.028797 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-38c0195d-a7b6-4246-beaf-09e9e25dff8e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.212528 Jun 20 12:25:24.029479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 170/333] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:23 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:24.371563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-2c7ebc7d-840b-4667-8986-696e3b1c271a req-e80bc49c-2589-48d9-a61b-da105f2388ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723b236d-b42a-49bd-82e5-8cdbd77ae671", "tag": "ba5cd384-36f6-4125-957f-80c90a4cfa50"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:24.386763 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2c7ebc7d-840b-4667-8986-696e3b1c271a req-e80bc49c-2589-48d9-a61b-da105f2388ef service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:24.387294 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2c7ebc7d-840b-4667-8986-696e3b1c271a req-e80bc49c-2589-48d9-a61b-da105f2388ef service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:24.404969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-2c7ebc7d-840b-4667-8986-696e3b1c271a req-e80bc49c-2589-48d9-a61b-da105f2388ef service nova] Creating event network-changed:ba5cd384-36f6-4125-957f-80c90a4cfa50 for instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 on hv-cinder-83697 Jun 20 12:25:24.410522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-2c7ebc7d-840b-4667-8986-696e3b1c271a req-e80bc49c-2589-48d9-a61b-da105f2388ef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044319 Jun 20 12:25:24.411107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 164/334] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:24.775458 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:24.776065 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:24.782723 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:24.783169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:24.783927 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:24.784354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:24.850699 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:24.852288 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:24.858468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:24.858921 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:24.859690 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:24.860120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:24.940363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:24.951740 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7b98e663-9648-4b86-9561-76ff6b4ad259 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1712 microversion: 2.1 time: 0.180719 Jun 20 12:25:24.952893 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 171/335] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:24 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1712 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:25.016478 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:25.024429 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-55169357-d3af-4a85-9571-2dab544ef7c5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.177954 Jun 20 12:25:25.025217 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 165/336] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:24 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:25.049762 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:25.050487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:25.057997 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:25.058742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:25.059596 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:25.060238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:25.203445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:25.211800 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-50445e73-f372-4990-ac25-b7e11672e40a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.169738 Jun 20 12:25:25.212360 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 172/337] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:25 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:26.043536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:26.044189 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:26.051014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.051489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:26.052376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.052812 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:26.069831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:26.103563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=6 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:26.202434 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:26.210015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9eda5689-cb34-4722-bc19-2fd3a6a50b1c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.171266 Jun 20 12:25:26.210574 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 166/338] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:26 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:26.228387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:26.229009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:26.235936 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.236391 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:26.237158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:26.237695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:26.378404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:26.388013 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-252e5b0c-b75e-455c-8342-9d24068f366f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.163351 Jun 20 12:25:26.388893 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 173/339] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:26 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:27.227380 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:27.227986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:27.234321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:27.234818 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:27.235587 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:27.236020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:27.392007 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:27.403144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-abbd64e3-c6ef-499c-b6ff-c360e845937c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.179270 Jun 20 12:25:27.406747 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:27.408490 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:27.414181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 167/340] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:27 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:27.415098 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=10 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:27.417598 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:27.417830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:27.418781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:27.419235 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:27.563860 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:27.572756 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-207cc70b-c253-43c1-b022-d7cbdd7c43e2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.171441 Jun 20 12:25:27.573317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 174/341] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:27 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:28.421268 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:28.421945 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:28.428571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.429019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:28.429847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.430480 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:28.574217 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:28.583204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a82530e1-cbeb-4704-8e43-e09a56a8f868 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.165757 Jun 20 12:25:28.583922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 168/342] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:28 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:28.592123 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:28.592844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:28.599997 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.600444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:28.601202 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:28.602039 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:28.738421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:28.746135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-99d371e1-f34a-47a9-844e-042e86fe7d5d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.158178 Jun 20 12:25:28.746701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 175/343] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:28 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:29.600153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:29.600827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:29.608809 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:29.609264 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:29.610137 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:29.610576 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:29.749402 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:29.756858 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c6310d71-ae27-4f99-ae80-08dbb332f0fa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.160788 Jun 20 12:25:29.757415 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 169/344] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:29 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:29.764591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:29.765201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:29.771816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:29.772448 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:29.773271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:29.774366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:29.908815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:29.917429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3c0fc70c-9a31-4011-9819-6eba52bf2dce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.156546 Jun 20 12:25:29.918050 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 176/345] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:29 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:30.773421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:30.774830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:30.781769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.782234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:30.783021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.783450 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:30.915516 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:30.924092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-63da706a-af55-49b1-b382-f54783ad49ec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.154306 Jun 20 12:25:30.934249 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:30.934829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:30.938423 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 170/346] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:30 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:30.943700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.944155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:30.944931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:30.945372 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:31.084505 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:31.092080 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-35e0d40c-11d3-4ca9-9fbd-58ad49bf0ea7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.161697 Jun 20 12:25:31.092650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 177/347] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:30 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:31.946615 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:31.947335 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:31.953776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:31.954255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:31.955167 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:31.955596 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:32.115457 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:32.115457 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:32.131350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:32.134704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:32.135710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:32.136309 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:32.176388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:32.185071 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bf029140-fe36-430a-bbf8-ff1e0675ed41 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.242931 Jun 20 12:25:32.185649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 171/348] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:31 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:32.370553 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:32.378033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4cba4f7e-ab5b-4dfb-970c-b2f1dc639ab9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.272749 Jun 20 12:25:32.378704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 178/349] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:32 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:33.202585 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:33.203186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:33.205437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:33.210230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.210672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.211426 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.211953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.350635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:33.354511 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:33.358850 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2b6fe0ea-16ab-4ed8-bc22-41e70d62477e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.160287 Jun 20 12:25:33.359425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 172/350] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:33 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:33.395531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:33.396146 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:33.404325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.404771 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.405575 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:33.406074 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:33.544960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:33.552229 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d9154393-9a39-4c43-87c3-8e696bc02de2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.160802 Jun 20 12:25:33.562190 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 179/351] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:33 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:34.138929 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-a43176fd-d83c-4de9-842a-a747f4ba011b req-73968476-4307-4e9b-9aba-f139d1284d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723b236d-b42a-49bd-82e5-8cdbd77ae671", "name": "network-vif-plugged", "status": "completed", "tag": "ba5cd384-36f6-4125-957f-80c90a4cfa50"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:34.159295 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-a43176fd-d83c-4de9-842a-a747f4ba011b req-73968476-4307-4e9b-9aba-f139d1284d8d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.159968 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-a43176fd-d83c-4de9-842a-a747f4ba011b req-73968476-4307-4e9b-9aba-f139d1284d8d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.173386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-a43176fd-d83c-4de9-842a-a747f4ba011b req-73968476-4307-4e9b-9aba-f139d1284d8d service nova] Creating event network-vif-plugged:ba5cd384-36f6-4125-957f-80c90a4cfa50 for instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 on hv-cinder-83697 Jun 20 12:25:34.183882 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-a43176fd-d83c-4de9-842a-a747f4ba011b req-73968476-4307-4e9b-9aba-f139d1284d8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049278 Jun 20 12:25:34.184509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 173/352] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:34.376582 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:34.377230 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:34.385321 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.386255 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.387211 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.387825 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.531156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:34.538820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-87005e4d-928d-47c5-958e-2fd6c287ae47 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.166071 Jun 20 12:25:34.539379 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 180/353] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:34 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:34.571255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:34.572753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:34.579709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.580161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.580929 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:34.581367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:34.785401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:34.798457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-86879a6d-5dfb-448d-9cb9-8d4b86c10482 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.232078 Jun 20 12:25:34.799485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 174/354] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:34 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:35.555907 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:35.561559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:35.578696 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.578696 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.578696 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.578696 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.582339 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:35.756989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:35.765404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d35185c6-59d3-4b48-b8d6-ace11a47c3b5 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.213560 Jun 20 12:25:35.766239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 181/355] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:35 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:35.816700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:35.817422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:35.825430 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.825920 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.826735 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:35.827173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:35.970353 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:35.979419 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f6601c32-557d-4e55-9661-478c8e62d9fc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1366 microversion: 2.1 time: 0.166679 Jun 20 12:25:35.979988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 175/356] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:35 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:36.784660 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:36.785271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:36.791924 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:36.792369 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:36.793175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:36.793611 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:36.934830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:36.942925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-30800ca8-ed7d-4f9f-bca6-ad0ffce4d51c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.162510 Jun 20 12:25:36.943516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 182/357] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:36 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:36.996340 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:36.996956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:37.003677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.004156 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:37.004925 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.005365 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:37.143303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:37.150872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e2d73aed-a2c3-4bee-acad-ef7f1f22a1dd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1555 microversion: 2.1 time: 0.158602 Jun 20 12:25:37.151434 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 176/358] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:36 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:37.171171 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-900de994-1edc-4df0-b3e1-edfd2901f303 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:37.171708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-900de994-1edc-4df0-b3e1-edfd2901f303 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:37.177876 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-900de994-1edc-4df0-b3e1-edfd2901f303 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.178333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-900de994-1edc-4df0-b3e1-edfd2901f303 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:37.179167 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-900de994-1edc-4df0-b3e1-edfd2901f303 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.179606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-900de994-1edc-4df0-b3e1-edfd2901f303 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:37.258258 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-900de994-1edc-4df0-b3e1-edfd2901f303 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092029 Jun 20 12:25:37.258849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 183/359] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:25:37 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:25:37.962375 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:37.963332 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:37.973418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.974200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:37.975290 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:37.975836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.143212 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:38.151785 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d854ca01-1b70-4626-bf29-b63b9e747503 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.194919 Jun 20 12:25:38.153613 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 177/360] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:37 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:38.407512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-1d8a6c96-7a4d-46e7-94b6-456993dd3af3 req-84fa229c-4ac6-4557-be15-211d9e3aa2df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723b236d-b42a-49bd-82e5-8cdbd77ae671", "tag": "ba5cd384-36f6-4125-957f-80c90a4cfa50"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:38.407512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1d8a6c96-7a4d-46e7-94b6-456993dd3af3 req-84fa229c-4ac6-4557-be15-211d9e3aa2df service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:38.407512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1d8a6c96-7a4d-46e7-94b6-456993dd3af3 req-84fa229c-4ac6-4557-be15-211d9e3aa2df service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:38.409737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-1d8a6c96-7a4d-46e7-94b6-456993dd3af3 req-84fa229c-4ac6-4557-be15-211d9e3aa2df service nova] Creating event network-changed:ba5cd384-36f6-4125-957f-80c90a4cfa50 for instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 on hv-cinder-83697 Jun 20 12:25:38.414168 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-1d8a6c96-7a4d-46e7-94b6-456993dd3af3 req-84fa229c-4ac6-4557-be15-211d9e3aa2df service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031877 Jun 20 12:25:38.414767 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 184/361] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:39.171700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:39.172285 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:39.178817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:39.179196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:39.179996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:39.180434 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:39.318999 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:39.327675 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f67af088-c16e-48a4-b35a-cbea7f2396a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.160175 Jun 20 12:25:39.328259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 178/362] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:39 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:40.346299 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:40.347000 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:40.353165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:40.353614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:40.354406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:40.354851 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:40.788586 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:40.798332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5f7137d2-321b-432f-9d51-53654db42be9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.456781 Jun 20 12:25:40.798942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 185/363] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:40 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:41.815238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:41.815884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:41.822774 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:41.823213 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:41.823984 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:41.825554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:41.967805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:41.975564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c7930a61-11bc-482b-9957-ec4375771be4 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.164205 Jun 20 12:25:41.986317 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 179/364] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:41 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:42.994721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:42.995447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:43.002404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:43.002859 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:43.003643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:43.004084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:43.136790 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:43.144920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-df8f596c-5f87-4208-ad54-9e72f2312cb9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.154742 Jun 20 12:25:43.145422 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 186/365] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:42 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:44.162387 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:44.162998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:44.170173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:44.170624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:44.171394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:44.171833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:44.312690 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:44.320303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ccb4836c-ac62-4fc6-b459-89b187956b33 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.161749 Jun 20 12:25:44.320866 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 180/366] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:44 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:45.336767 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:45.337444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:45.344831 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.345277 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.355695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.355695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.492848 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:45.500996 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-94cfd42f-c9c9-41fe-a0e9-d809fc4c3855 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1501 microversion: 2.1 time: 0.167912 Jun 20 12:25:45.501557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 187/367] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:45 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:45.518444 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb34a500-df9b-4d14-ae5c-b71f3b5cff39"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:45.520376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:45.532487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.532487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.532487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.532487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.553581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] HTTP exception thrown: Cannot 'attach_volume' instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff while it is in vm_state rescued Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Request method failure captured: Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: POST /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff/os-volume_attachments HTTP/1.1 Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 74 Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasLiox8v87mMMuwvB5sZLcpwnf36uVrAHw--DgUS8DCscm1DRQBuIFjvtXKdxnBr75BzdkY482ZHjnhHiobtA8rsvW9-z5k8IPw23hqm5Wh1-h4YBXq5kxbtrCEQmRsxIjJtXX1ahdUgulZfrYKcQ53zxnssFmkP-XIfdpo9hhlD4 Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:25:45.555493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}] Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: ec4c5293e6a148a2a16ba4c3fc57a3a3 Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {"volumeAttachment": {"volumeId": "cb34a500-df9b-4d14-ae5c-b71f3b5cff39"}} Jun 20 12:25:45.557069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Cannot 'attach_volume' instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff while it is in vm_state rescued Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'server_id': '108e8e51-7234-4ddc-9ff6-6e2bfed530ff', 'body': {'volumeAttachment': {'volumeId': 'cb34a500-df9b-4d14-ae5c-b71f3b5cff39'}}} Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:25:45.558045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff while it is in vm_state rescued Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:25:45.559561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:25:45.560980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:25:45.560980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:25:45.560980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff while it is in vm_state rescued Jun 20 12:25:45.560980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:25:45.560980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Returning 409 to user: Cannot 'attach_volume' instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff while it is in vm_state rescued {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:25:45.560980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8cffc48e-ee9c-4642-ad1b-dd2a04507aee tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042404 Jun 20 12:25:45.560980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 181/368] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:25:45 2022] POST /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:25:45.566524 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0eaa3705-0bd0-4e3c-ab26-a88fe904b603 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:45.567175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0eaa3705-0bd0-4e3c-ab26-a88fe904b603 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:45.573492 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0eaa3705-0bd0-4e3c-ab26-a88fe904b603 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.573960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0eaa3705-0bd0-4e3c-ab26-a88fe904b603 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.575977 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0eaa3705-0bd0-4e3c-ab26-a88fe904b603 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.576439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0eaa3705-0bd0-4e3c-ab26-a88fe904b603 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.839351 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0eaa3705-0bd0-4e3c-ab26-a88fe904b603 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff/action" status: 202 len: 0 microversion: 2.1 time: 0.276750 Jun 20 12:25:45.839896 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 188/369] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:25:45 2022] POST /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:25:45.849283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:45.850054 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:45.857503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.861792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:45.861792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:45.861792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:46.022729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:46.036382 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b32956f1-9fd3-4d7c-9ea1-eac900588032 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1509 microversion: 2.1 time: 0.190727 Jun 20 12:25:46.036965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 182/370] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:45 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:47.057829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:47.058555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:47.066366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:47.066844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:47.067638 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:47.068293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:47.213647 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:47.221498 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1705e61c-8a50-41ca-9b3e-da4b5be71a12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1509 microversion: 2.1 time: 0.168391 Jun 20 12:25:47.222100 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 189/371] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:47 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:48.240335 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:48.240946 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:48.248915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:48.249374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:48.250189 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:48.250629 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:48.397203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:48.406103 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1924c5a0-6928-40fd-b94d-934a05885c9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1509 microversion: 2.1 time: 0.169525 Jun 20 12:25:48.406677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 183/372] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:48 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:49.422411 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:49.422932 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:49.429490 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.434588 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.434588 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:49.434588 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:49.563504 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:49.571272 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-acbb67b4-db5f-4f00-9d38-60918965bb53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1509 microversion: 2.1 time: 0.152845 Jun 20 12:25:49.571836 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 190/373] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:49 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:50.588234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:50.588838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:50.595297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.595745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.596501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:50.596930 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:50.725715 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:50.734302 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f975eed9-4f6e-49e6-8bae-1ca932119001 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1509 microversion: 2.1 time: 0.149829 Jun 20 12:25:50.734871 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 184/374] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:50 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:50.958804 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2059101403", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1801647061", "security_groups": [{"name": "tempest-secgroup-smoke-1501737873"}], "networks": [{"uuid": "f520cf05-e45f-4524-8676-b3be203829e8"}], "block_device_mapping_v2": [{"uuid": "45518905-d88e-405e-8995-e41cdfa4f77a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:51.091810 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] validate_networks() for [('f520cf05-e45f-4524-8676-b3be203829e8', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:25:51.266770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=56 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:51.472007 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:51.475301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:51.475301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:51.475301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:51.475301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:51.483156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.483616 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.484427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.484867 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.502252 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Getting quotas for project ae372a6537684625acb82b36862bde25. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:51.506315 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Getting quotas for user 85d4be423d794100ac5b00d32fb5620c and project ae372a6537684625acb82b36862bde25. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:51.571471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:25:51.573650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45518905-d88e-405e-8995-e41cdfa4f77a',volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:25:51.751204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:51.751804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:51.758214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.758655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.761226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:51.761226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:51.905115 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:51.912654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-844a009a-c27a-409e-9a8a-62a6582b2974 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1509 microversion: 2.1 time: 0.165361 Jun 20 12:25:51.913584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 185/375] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:51 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:25:52.038235 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ea1c7ee9-b176-492d-b82a-73c5ec848927 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.083290 Jun 20 12:25:52.039591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 191/376] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:25:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:25:52.051876 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1f3d7d7f-2734-4f53-ae36-9829a89d0b4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:52.057378 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1f3d7d7f-2734-4f53-ae36-9829a89d0b4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:52.110656 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1f3d7d7f-2734-4f53-ae36-9829a89d0b4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:52.117619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1f3d7d7f-2734-4f53-ae36-9829a89d0b4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1089 microversion: 2.1 time: 0.069652 Jun 20 12:25:52.118243 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 186/377] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:52 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:52.931288 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:52.931288 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:52.937032 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.937487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:52.938314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:52.938780 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.078770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:53.087705 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3c4a1d35-20f2-428a-bb89-00d9cdc500ff tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1515 microversion: 2.1 time: 0.162298 Jun 20 12:25:53.088278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 192/378] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:52 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:53.135753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:53.136417 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:53.144471 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.144908 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.145672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:53.146123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:53.214955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:53.224838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-22a21384-99ca-4d3c-b461-6286dc9be3a1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1139 microversion: 2.1 time: 0.092243 Jun 20 12:25:53.234092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 187/379] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:53 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1139 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:54.240325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:54.240899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:54.247473 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.247915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.248685 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:54.249106 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:54.313582 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:54.321949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-30fbc3aa-415b-44bd-bfa7-220f9e34fc48 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1187 microversion: 2.1 time: 0.085496 Jun 20 12:25:54.322597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 193/380] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:54 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:54.938258 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-93d33bd8-17b9-4719-9d9c-b6ee32d8f042 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'create', calling method: .version_select at 0x7fe291339dc0>, body: {"keypair": {"name": "tempest-keypair-1504275162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/xVDmf6kl+ahd1mQ4A31j70O8YyeoakIUcVs/IH3kYp1HX0R6LWm3imoMhJOXVDehb+Zg9ofnxeI0yYHlV0Udr133yKLwv3BykXru+Vu9ia7g6MFOQu8Pb9BVvesnPhg=="}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:54.957620 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-93d33bd8-17b9-4719-9d9c-b6ee32d8f042 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'key_pairs'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:54.961554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-93d33bd8-17b9-4719-9d9c-b6ee32d8f042 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for user ec4c5293e6a148a2a16ba4c3fc57a3a3 and project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'key_pairs'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:55.061148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-93d33bd8-17b9-4719-9d9c-b6ee32d8f042 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127159 Jun 20 12:25:55.067557 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 188/381] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:25:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:55.339517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:55.340251 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:55.347455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.347910 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.348684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:55.349124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:55.420638 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:55.434954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-006aa782-a946-48af-b0f3-898f673c1bdf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1205 microversion: 2.1 time: 0.099344 Jun 20 12:25:55.435908 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 194/382] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:55 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:56.456129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:56.456917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:56.470481 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.470951 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.474891 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.475367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.785479 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:56.793276 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b5ccaea8-3198-4de1-b509-6b848458a487 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1273 microversion: 2.1 time: 0.345985 Jun 20 12:25:56.794824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 189/383] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:56 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:56.871243 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-aa80aa61-35de-446e-a5e1-9dc13ab1e775 req-098d9ffe-70f3-4594-82c4-4e8a426e8c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53262aa-7cf3-44ef-a688-cac5131e08bb", "tag": "65f8231e-4b5e-4ec6-805b-a7feee02eab0"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:56.887445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-aa80aa61-35de-446e-a5e1-9dc13ab1e775 req-098d9ffe-70f3-4594-82c4-4e8a426e8c83 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:56.888164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-aa80aa61-35de-446e-a5e1-9dc13ab1e775 req-098d9ffe-70f3-4594-82c4-4e8a426e8c83 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:56.900304 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-aa80aa61-35de-446e-a5e1-9dc13ab1e775 req-098d9ffe-70f3-4594-82c4-4e8a426e8c83 service nova] Creating event network-changed:65f8231e-4b5e-4ec6-805b-a7feee02eab0 for instance b53262aa-7cf3-44ef-a688-cac5131e08bb on hv-cinder-83697 Jun 20 12:25:56.913950 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-aa80aa61-35de-446e-a5e1-9dc13ab1e775 req-098d9ffe-70f3-4594-82c4-4e8a426e8c83 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044791 Jun 20 12:25:56.914751 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 195/384] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:25:57.811491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:57.812162 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:57.818777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:57.819187 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:57.819974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:57.820393 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:57.958218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:57.965769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-87197422-8fae-4f1e-a388-7ad380ad1f17 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.159366 Jun 20 12:25:57.966552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 190/385] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:57 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:58.170463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-292119362", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb2cad9e-caeb-44ad-af38-7ce84a4c3771"}], "security_groups": [{"name": "tempest-securitygroup--2038927054"}], "key_name": "tempest-keypair-1504275162", "user_data": "}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:25:58.272731 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] validate_networks() for [('bb2cad9e-caeb-44ad-af38-7ce84a4c3771', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:25:58.847179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:25:58.847600 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:25:58.848074 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:25:58.848480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:25:58.848900 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:25:58.858842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.859317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.860128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.860562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.877557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:25:58.881480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Getting quotas for user ec4c5293e6a148a2a16ba4c3fc57a3a3 and project d55e2a4f35944f65bb0d5b1382b8cafc. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:25:58.892447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:25:58.894772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:25:58.982823 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:58.983447 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:58.989985 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.990469 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:58.991227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:25:58.991658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:25:59.049483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b7c59185-1a72-4610-af81-2cffa7f81f56 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.884234 Jun 20 12:25:59.050518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 196/386] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:25:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:25:59.061061 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8ee01aa6-f990-49e9-81e2-a5a53b1e394e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:25:59.062087 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8ee01aa6-f990-49e9-81e2-a5a53b1e394e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:25:59.128596 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:59.133686 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8ee01aa6-f990-49e9-81e2-a5a53b1e394e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:25:59.137058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-abc45242-3b7b-4fc3-921e-7197e07930e3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.158551 Jun 20 12:25:59.138346 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 191/387] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:58 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:25:59.142099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8ee01aa6-f990-49e9-81e2-a5a53b1e394e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1245 microversion: 2.1 time: 0.085699 Jun 20 12:25:59.142859 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 197/388] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:25:59 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:00.154824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:00.155640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:00.158938 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:00.159547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:00.162598 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.163050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.163907 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.164345 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.166307 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.174265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.174265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:00.174265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:00.185518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:00.232380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:00.239356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a9193ef1-31e9-4c09-99d8-3d9944466378 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1249 microversion: 2.1 time: 0.084284 Jun 20 12:26:00.239922 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 198/389] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:00 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:00.302666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:00.310901 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b4eeebb4-a327-4e8c-ab2e-8bbca1480569 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.160157 Jun 20 12:26:00.311492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 192/390] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:00 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:01.256936 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:01.257897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:01.265013 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.265466 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.266280 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.266723 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.328605 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:01.329313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:01.334283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:01.336214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.336737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.337585 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:01.338091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:01.342313 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-386fe26e-4a35-4346-8f97-3020932ef7af tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1297 microversion: 2.1 time: 0.089367 Jun 20 12:26:01.342892 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 199/391] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:01 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:01.483476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:01.491630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-02776321-71c0-4e7d-ace1-4727addc23c9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.167695 Jun 20 12:26:01.497264 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 193/392] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:01 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:02.389792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:02.389792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:02.389792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.389792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.390551 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.390551 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.463347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:02.468115 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:02.478026 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8e55a9fd-c56a-4618-88de-7f2421549919 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1303 microversion: 2.1 time: 0.121913 Jun 20 12:26:02.478607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 200/393] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:02 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:02.508610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:02.509220 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:02.516929 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.517388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.518219 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:02.518656 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:02.744672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:02.753260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3e91f95a-1c27-4dca-b7d2-b87d9292779a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.248623 Jun 20 12:26:02.754145 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 194/394] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:02 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:03.506642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:03.506642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:03.524519 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.524972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.525749 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.528924 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.695686 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:03.699653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-0b134d4f-bc54-4c39-8fde-9ee5ca3e1966 req-44b5fd7e-6231-4e8c-a047-728eec2b3bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4", "tag": "dfa767d1-2961-4d8b-8953-7eb7df3db7da"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:03.710169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c20c6cc9-30e3-46dc-b7cd-c7f10c65bc3b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.214741 Jun 20 12:26:03.726063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 201/395] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:03 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:03.732973 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-0b134d4f-bc54-4c39-8fde-9ee5ca3e1966 req-44b5fd7e-6231-4e8c-a047-728eec2b3bf3 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.733658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-0b134d4f-bc54-4c39-8fde-9ee5ca3e1966 req-44b5fd7e-6231-4e8c-a047-728eec2b3bf3 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.748199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-0b134d4f-bc54-4c39-8fde-9ee5ca3e1966 req-44b5fd7e-6231-4e8c-a047-728eec2b3bf3 service nova] Creating event network-changed:dfa767d1-2961-4d8b-8953-7eb7df3db7da for instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 on hv-cinder-83697 Jun 20 12:26:03.753399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-0b134d4f-bc54-4c39-8fde-9ee5ca3e1966 req-44b5fd7e-6231-4e8c-a047-728eec2b3bf3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059982 Jun 20 12:26:03.754146 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 195/396] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:03.770764 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:03.771713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:03.779099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.779846 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.780645 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:03.781087 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:03.963977 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:03.976782 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2ad194d3-ba42-48c7-b4af-9333783e3e04 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.205281 Jun 20 12:26:03.976782 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 202/397] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:03 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:04.734046 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:04.734662 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:04.736584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:04.741495 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.742007 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.742747 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.743176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.876915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:04.884320 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-33db0bf8-4df9-44cb-93a7-c5c2467157c0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.155568 Jun 20 12:26:04.884880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 196/398] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:04 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:04.989785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:04.991019 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:04.998713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:04.999166 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:04.999945 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.000566 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.140065 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:05.147678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1056c46f-3ab2-4b59-b111-1d16ed722bc2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.161843 Jun 20 12:26:05.148249 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 203/399] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:04 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:05.902504 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:05.904159 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:05.906755 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=6 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:05.912432 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.912888 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:05.913709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:05.914150 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:06.055286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:06.065501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-30441bc6-9089-4a2a-863f-3be75dfbaace tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.167153 Jun 20 12:26:06.077448 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 197/400] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:05 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:06.164506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:06.165224 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:06.171996 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:06.172440 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:06.173381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:06.173904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:06.310746 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:06.318881 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4317ac97-f855-414e-b23f-6ea55e8dfad7 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.158241 Jun 20 12:26:06.330449 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 204/401] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:06 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:07.082880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:07.083519 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:07.090073 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.094344 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.094344 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.094344 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.245476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:07.253246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e3507189-110d-4542-b1e0-05b2872c2221 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.174482 Jun 20 12:26:07.255729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 198/402] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:07 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:07.336462 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:07.337728 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:07.344437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.344928 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.347213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:07.347213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:07.486824 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:07.494943 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-adb9d89a-4f8b-406a-99c3-4a664c41fbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.162335 Jun 20 12:26:07.498194 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 205/403] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:07 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:08.269795 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:08.270427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:08.277249 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.277695 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.278993 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.279425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.428412 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:08.436610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6d845ed5-ccf5-4846-a93d-b17201e3b352 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.170922 Jun 20 12:26:08.437358 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 199/404] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:08 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:08.513093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:08.514366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:08.520905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.521349 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.522238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:08.522675 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:08.685383 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:08.693293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-128fd320-5a25-47a0-9efa-90782bc76624 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.185723 Jun 20 12:26:08.693868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 206/405] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:08 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:09.454435 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:09.455072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:09.461881 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.462330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.463094 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.463524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.623536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:09.639580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2fe47c49-85ab-4ca9-98c4-9078ff9ffe40 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.189730 Jun 20 12:26:09.640566 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 200/406] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:09 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:09.711702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:09.712413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:09.715147 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=4 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:09.716416 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=14 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:09.720811 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.721265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.722075 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:09.722515 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:09.856889 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:09.864595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e48acfeb-fa06-4e52-a796-50c92741dbd9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.156833 Jun 20 12:26:09.865169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 207/407] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:09 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:10.657518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:10.658307 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:10.665354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.667524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.667524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.667524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.757126 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1324062164", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "networks": [{"uuid": "d66b3092-b630-48bc-83c0-f6e6929a752b"}]}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:10.816321 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] validate_networks() for [('d66b3092-b630-48bc-83c0-f6e6929a752b', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:26:10.839846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:10.844991 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f02e4b72-8f76-4e41-8436-94bb833f3ff6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.192220 Jun 20 12:26:10.845655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 201/408] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:10 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:10.881429 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:10.882062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:10.888673 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.889118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:10.889901 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:10.890333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:11.047449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:11.055175 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-28d84ff7-e1f4-4815-9fc7-4a6d1a7e4fb3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.177821 Jun 20 12:26:11.055824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 202/409] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:10 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:11.197356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:26:11.197874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:26:11.198417 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:26:11.198866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:26:11.199317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:26:11.213156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:11.213953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:11.215005 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:11.215457 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:11.235942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Getting quotas for project d9b0e8111c084f769bbc267365364900. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:26:11.240751 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Getting quotas for user 7c5ef23fbdb145bfa485859ff4c43b4c and project d9b0e8111c084f769bbc267365364900. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:26:11.256581 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:26:11.258889 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:26:11.397750 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0bec7bbe-8008-48a2-9068-ee7a967d78ba tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645085 Jun 20 12:26:11.398440 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 208/410] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:26:11.408852 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-daa063cf-94cc-490b-9741-385ceecbf26c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:11.409459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-daa063cf-94cc-490b-9741-385ceecbf26c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:11.463837 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-daa063cf-94cc-490b-9741-385ceecbf26c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:11.472120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-daa063cf-94cc-490b-9741-385ceecbf26c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1219 microversion: 2.1 time: 0.067327 Jun 20 12:26:11.472818 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 203/411] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:11 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:11.861899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:11.862518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:11.869331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:11.871379 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:11.871379 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:11.871379 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.015475 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:12.023283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-57cb858b-eb86-451b-b58b-67f05d4e06fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.165401 Jun 20 12:26:12.023853 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 209/412] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:11 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:12.072831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:12.074474 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:12.081782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:12.082632 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.083416 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:12.083853 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.242319 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:12.251623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0a4a6157-8542-4a66-b1d7-6ea116a8c0aa tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.182996 Jun 20 12:26:12.252190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 204/413] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:12 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:12.263670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-4fffe003-ee9e-4c32-a631-f543b20ac2b1 req-76d9e2ff-6e94-49c1-9c81-5628e7d31d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4", "name": "network-vif-plugged", "status": "completed", "tag": "dfa767d1-2961-4d8b-8953-7eb7df3db7da"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:12.272157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-4fffe003-ee9e-4c32-a631-f543b20ac2b1 req-76d9e2ff-6e94-49c1-9c81-5628e7d31d4e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:12.272553 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-4fffe003-ee9e-4c32-a631-f543b20ac2b1 req-76d9e2ff-6e94-49c1-9c81-5628e7d31d4e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:12.283993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-4fffe003-ee9e-4c32-a631-f543b20ac2b1 req-76d9e2ff-6e94-49c1-9c81-5628e7d31d4e service nova] Creating event network-vif-plugged:dfa767d1-2961-4d8b-8953-7eb7df3db7da for instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 on hv-cinder-83697 Jun 20 12:26:12.289108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-4fffe003-ee9e-4c32-a631-f543b20ac2b1 req-76d9e2ff-6e94-49c1-9c81-5628e7d31d4e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029621 Jun 20 12:26:12.290073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 210/414] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:12.490313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a203ca5c-079d-4324-b671-54f293089b0e tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:12.490938 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a203ca5c-079d-4324-b671-54f293089b0e tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:12.546684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a203ca5c-079d-4324-b671-54f293089b0e tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:12.553624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a203ca5c-079d-4324-b671-54f293089b0e tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1219 microversion: 2.1 time: 0.067364 Jun 20 12:26:12.554368 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 205/415] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:12 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:13.041104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:13.041823 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:13.048169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.048625 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.049393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.049857 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.177425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:13.186023 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c3ed2b88-c600-4d31-afab-b736748586c8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.149510 Jun 20 12:26:13.186599 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 211/416] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:13 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:13.269676 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:13.270283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:13.276740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.277185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.278015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.278422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.412058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:13.419689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8238aa36-c924-485d-ace4-4bc045998a93 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.154306 Jun 20 12:26:13.420259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 206/417] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:13 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:13.576653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:13.577268 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:13.583389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.583842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.584619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:13.585058 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:13.650493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:13.658392 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-662b2912-34ec-44a3-8869-ee2840b72268 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1223 microversion: 2.1 time: 0.085769 Jun 20 12:26:13.658974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 212/418] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:13 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:14.202809 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:14.203564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:14.210390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.210938 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.211755 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.212232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.348158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:14.355553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7828fc34-182c-443d-ad87-5fbfda969190 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.156853 Jun 20 12:26:14.356116 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 207/419] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:14 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:14.437183 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:14.437794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:14.444453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.444899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.445660 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.446115 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.577389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:14.585009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2f9a3d2f-d098-43a7-aec6-0f2c1d95d21c tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.152458 Jun 20 12:26:14.585650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 213/420] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:14 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:14.676693 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:14.677711 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:14.689526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.690029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.691017 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:14.691529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:14.752611 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:14.760065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-639d8971-86c1-44a0-80fe-78b2750ac06c tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1223 microversion: 2.1 time: 0.088264 Jun 20 12:26:14.760625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 208/421] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:14 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:15.373336 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:15.374024 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:15.380584 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.381040 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.381836 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.382282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.517976 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:15.527795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5f6b28e3-a70f-4d7e-8421-339a294c26b6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.158957 Jun 20 12:26:15.528360 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 214/422] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:15 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:15.604113 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:15.605292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:15.614071 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.614747 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.615533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.615999 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.766044 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:15.773737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-39d863fc-ef31-4eb7-95b5-58db1e652120 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.174645 Jun 20 12:26:15.783540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 209/423] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:15 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:15.783939 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:15.783939 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:15.788064 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.788553 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.789342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:15.789785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:15.856091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:15.863741 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a0542c51-d364-4e56-aad9-b6c9d60cd900 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1271 microversion: 2.1 time: 0.090146 Jun 20 12:26:15.864334 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 215/424] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:15 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:16.546171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:16.546785 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:16.560604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.560604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.560604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.560604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.727769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:16.737035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a1d05f07-f529-4c7d-a90f-493a9e8df763 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1371 microversion: 2.1 time: 0.195391 Jun 20 12:26:16.738406 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 210/425] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:16 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:16.791325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:16.792772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:16.800464 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.800918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.801921 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.802880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.881489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:16.882133 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:16.894022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.894475 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.896649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:16.897114 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:16.986451 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:16.999959 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-eb814536-f3a0-41c9-8e50-a0767389ab54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.212402 Jun 20 12:26:17.000840 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 216/426] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:16 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:17.245027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:17.249725 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:17.254204 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c3c39893-cfa4-4597-a6c4-de68e6732b56 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1277 microversion: 2.1 time: 0.377249 Jun 20 12:26:17.255289 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 211/427] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:16 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1277 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:17.755237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:17.756183 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:17.764665 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:17.765110 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:17.766168 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:17.766599 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:17.949838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:17.962519 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c5194789-0dcc-4228-9c57-c9641b2e7856 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1565 microversion: 2.1 time: 0.211770 Jun 20 12:26:17.966883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 217/428] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:17 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:17.981556 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7bfb4d3d-321a-4f68-9ce5-03e02c552f06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:17.982953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7bfb4d3d-321a-4f68-9ce5-03e02c552f06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:17.990128 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d3d-321a-4f68-9ce5-03e02c552f06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:17.990906 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d3d-321a-4f68-9ce5-03e02c552f06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:17.991908 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d3d-321a-4f68-9ce5-03e02c552f06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:17.992578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7bfb4d3d-321a-4f68-9ce5-03e02c552f06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.018781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:18.019486 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:18.023132 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:18.028468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.029588 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.034869 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.035330 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.145378 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7bfb4d3d-321a-4f68-9ce5-03e02c552f06 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166823 Jun 20 12:26:18.150336 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 212/429] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:26:17 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:18.282075 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:18.283732 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:18.290579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.291374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.292459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.292954 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.324453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:18.329642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:18.335463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-dc9582c7-85ee-4930-8ce3-6066768dccd2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.322725 Jun 20 12:26:18.336044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 218/430] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:18 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:18.348220 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-02cb2a01-67b4-407b-a687-2a326ed0a365 req-332512a4-5185-4b9e-a285-f7833999bf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53262aa-7cf3-44ef-a688-cac5131e08bb", "name": "network-vif-plugged", "status": "completed", "tag": "65f8231e-4b5e-4ec6-805b-a7feee02eab0"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:18.356727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-02cb2a01-67b4-407b-a687-2a326ed0a365 req-332512a4-5185-4b9e-a285-f7833999bf8e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:18.357317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-02cb2a01-67b4-407b-a687-2a326ed0a365 req-332512a4-5185-4b9e-a285-f7833999bf8e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:18.370564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-02cb2a01-67b4-407b-a687-2a326ed0a365 req-332512a4-5185-4b9e-a285-f7833999bf8e service nova] Creating event network-vif-plugged:65f8231e-4b5e-4ec6-805b-a7feee02eab0 for instance b53262aa-7cf3-44ef-a688-cac5131e08bb on hv-cinder-83697 Jun 20 12:26:18.382578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-02cb2a01-67b4-407b-a687-2a326ed0a365 req-332512a4-5185-4b9e-a285-f7833999bf8e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038966 Jun 20 12:26:18.382578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 219/431] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:18.683323 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:18.692073 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e05770bd-03ec-4400-baa8-76ad6840e38f tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.416536 Jun 20 12:26:18.692716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 213/432] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:18 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:19.025205 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-c27bdf4e-4133-4f90-8eda-1f138aa4d343 req-237a5faa-bdad-46cf-bd6b-903ab706ac18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffe781f-e20e-44ed-b2ee-98a480b22e16", "tag": "a152becc-7b1c-458b-8a76-0109904c9d04"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:19.035351 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-c27bdf4e-4133-4f90-8eda-1f138aa4d343 req-237a5faa-bdad-46cf-bd6b-903ab706ac18 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.035797 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-c27bdf4e-4133-4f90-8eda-1f138aa4d343 req-237a5faa-bdad-46cf-bd6b-903ab706ac18 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.053278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-c27bdf4e-4133-4f90-8eda-1f138aa4d343 req-237a5faa-bdad-46cf-bd6b-903ab706ac18 service nova] Creating event network-changed:a152becc-7b1c-458b-8a76-0109904c9d04 for instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 on hv-cinder-83697 Jun 20 12:26:19.057141 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-c27bdf4e-4133-4f90-8eda-1f138aa4d343 req-237a5faa-bdad-46cf-bd6b-903ab706ac18 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036716 Jun 20 12:26:19.059221 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 220/433] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:19.352413 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:19.353020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:19.360961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.361405 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.362234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.362666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.609038 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:19.621333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ce25bfb5-d0ef-4d39-ae97-00210a03a458 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1261 microversion: 2.1 time: 0.272746 Jun 20 12:26:19.621931 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 214/434] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:19 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1261 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:19.709341 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:19.710373 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:19.717544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.718097 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.718879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:19.719317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:19.896797 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:19.919665 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cfc938b4-956f-4108-a835-51a9f85b4834 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.211173 Jun 20 12:26:19.920891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 221/435] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:19 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:20.638510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:20.641248 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:20.646922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.647583 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.648517 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.649114 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.896490 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:20.907485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-65b5a6ea-56a8-49bd-98db-471e143a9cc5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1445 microversion: 2.1 time: 0.272995 Jun 20 12:26:20.908695 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 215/436] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:20 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1445 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:20.925111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:20.925725 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:20.937260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:20.942345 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:20.942461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.942461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.943212 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.943851 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.946552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.948118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:20.948919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:20.949521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:21.148745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:21.153094 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:21.156963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6ac71d3a-04fb-4395-b5d5-e373cfdd2d64 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.224313 Jun 20 12:26:21.157547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 216/437] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:20 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:21.161863 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b03b068a-d227-44b0-bb8c-bc5932d54a54 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1445 microversion: 2.1 time: 0.240554 Jun 20 12:26:21.162093 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-51f18d18-72e1-4df1-a1a4-3cc3fe3606f2 req-b6b4b5eb-82a0-4986-8a67-4a4daff024c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4", "tag": "dfa767d1-2961-4d8b-8953-7eb7df3db7da"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:21.178660 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-51f18d18-72e1-4df1-a1a4-3cc3fe3606f2 req-b6b4b5eb-82a0-4986-8a67-4a4daff024c9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:21.178660 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-51f18d18-72e1-4df1-a1a4-3cc3fe3606f2 req-b6b4b5eb-82a0-4986-8a67-4a4daff024c9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:21.179042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 222/438] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:20 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1445 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:21.186575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-51f18d18-72e1-4df1-a1a4-3cc3fe3606f2 req-b6b4b5eb-82a0-4986-8a67-4a4daff024c9 service nova] Creating event network-changed:dfa767d1-2961-4d8b-8953-7eb7df3db7da for instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 on hv-cinder-83697 Jun 20 12:26:21.191956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-51f18d18-72e1-4df1-a1a4-3cc3fe3606f2 req-b6b4b5eb-82a0-4986-8a67-4a4daff024c9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033162 Jun 20 12:26:21.192838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 217/439] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:22.175310 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:22.175680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:22.180751 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:22.181948 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=6 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:22.184395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.185365 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.186487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:22.187154 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:22.457583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:22.490378 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7935cdbb-bc6a-4d96-8b51-bec93cdc5638 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.319319 Jun 20 12:26:22.500378 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 223/440] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:22 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:23.508532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:23.509227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:23.518082 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=4 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:23.520220 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.520850 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.521816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:23.522418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:23.765907 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:23.774588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-79766f05-9bbe-405b-be77-36231feeef70 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.270427 Jun 20 12:26:23.775672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 218/441] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:23 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:24.043263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-7c5d919d-9946-4a48-a478-e6977b17ac9a req-41be0321-e208-43f9-809e-5d4a38814294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53262aa-7cf3-44ef-a688-cac5131e08bb", "tag": "65f8231e-4b5e-4ec6-805b-a7feee02eab0"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:24.053975 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-7c5d919d-9946-4a48-a478-e6977b17ac9a req-41be0321-e208-43f9-809e-5d4a38814294 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.054667 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-7c5d919d-9946-4a48-a478-e6977b17ac9a req-41be0321-e208-43f9-809e-5d4a38814294 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:24.066370 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-7c5d919d-9946-4a48-a478-e6977b17ac9a req-41be0321-e208-43f9-809e-5d4a38814294 service nova] Creating event network-changed:65f8231e-4b5e-4ec6-805b-a7feee02eab0 for instance b53262aa-7cf3-44ef-a688-cac5131e08bb on hv-cinder-83697 Jun 20 12:26:24.071749 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-7c5d919d-9946-4a48-a478-e6977b17ac9a req-41be0321-e208-43f9-809e-5d4a38814294 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032793 Jun 20 12:26:24.072422 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 224/442] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:24.081278 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:24.083501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:24.106525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.107016 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:24.108106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.108253 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:24.284259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lazy-loading 'services' on Instance uuid d4a331a3-6307-47a9-b9b8-cd94a0217c11 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:24.616051 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-eb2416a5-e33e-46e0-a4f1-26838b94f28c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-volume_attachments/f34d5cbc-0636-4257-b763-d92ac616a928" status: 202 len: 0 microversion: 2.1 time: 0.538554 Jun 20 12:26:24.616892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 219/443] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:26:24 2022] DELETE /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-volume_attachments/f34d5cbc-0636-4257-b763-d92ac616a928 => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:24.796213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:24.796213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:24.814741 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.815508 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:24.816501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.817101 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:24.958157 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-ec95764a-7d96-416d-b9ca-7fd3bfd17466 req-9ce5b661-8584-4511-a7e0-2d2efbda46dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffe781f-e20e-44ed-b2ee-98a480b22e16", "name": "network-vif-plugged", "status": "completed", "tag": "a152becc-7b1c-458b-8a76-0109904c9d04"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:24.978965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ec95764a-7d96-416d-b9ca-7fd3bfd17466 req-9ce5b661-8584-4511-a7e0-2d2efbda46dd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:24.979994 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ec95764a-7d96-416d-b9ca-7fd3bfd17466 req-9ce5b661-8584-4511-a7e0-2d2efbda46dd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:24.991875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-ec95764a-7d96-416d-b9ca-7fd3bfd17466 req-9ce5b661-8584-4511-a7e0-2d2efbda46dd service nova] Creating event network-vif-plugged:a152becc-7b1c-458b-8a76-0109904c9d04 for instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 on hv-cinder-83697 Jun 20 12:26:25.004902 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-ec95764a-7d96-416d-b9ca-7fd3bfd17466 req-9ce5b661-8584-4511-a7e0-2d2efbda46dd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044827 Jun 20 12:26:25.005960 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 220/444] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:26:25.120857 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:25.134015 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7854f403-9675-4f13-b126-9e083a694611 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.345297 Jun 20 12:26:25.134604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 225/445] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:24 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:26.152812 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:26.153759 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:26.164482 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:26.164943 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:26.168464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:26.168464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:26.388865 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:26.399740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1f7b25d4-0108-40ac-91a5-1ba0e8b30835 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.251889 Jun 20 12:26:26.410787 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 221/446] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:26 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:26.845755 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e384f690-9f5c-4731-ba83-595b04ae6523 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:26.856696 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e384f690-9f5c-4731-ba83-595b04ae6523 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:26.857362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e384f690-9f5c-4731-ba83-595b04ae6523 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:26.896761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e384f690-9f5c-4731-ba83-595b04ae6523 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Going to try to stop instance {{(pid=118091) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 12:26:27.100395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e384f690-9f5c-4731-ba83-595b04ae6523 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action" status: 202 len: 0 microversion: 2.1 time: 0.258857 Jun 20 12:26:27.101191 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 226/447] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:26 2022] POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:27.109699 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:27.110753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:27.123408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.124004 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.124833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.125275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.363776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:27.373036 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-be7246ac-0f5a-4be4-a2f3-8c7d336ef0eb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.267199 Jun 20 12:26:27.398604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 222/448] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:27 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:27.423363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:27.424086 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:27.440315 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.442917 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.444002 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:27.444616 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:27.647208 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:27.655976 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f9d3905c-a255-40e7-b923-72a929c88347 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1319 microversion: 2.1 time: 0.241790 Jun 20 12:26:27.656844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 227/449] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:27 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:28.393264 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.394099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.401600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.402161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.404831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.406096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.594989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:28.604970 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bd391e79-bde8-436f-9d74-ae60a231a1ca tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.217303 Jun 20 12:26:28.605734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 223/450] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:28 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:28.673206 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:28.673922 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:28.688550 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.689003 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.689796 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:28.690264 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:28.869826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:28.882770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-15dd56eb-9486-4dda-9919-10ef8d002bc1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1507 microversion: 2.1 time: 0.213881 Jun 20 12:26:28.883931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 228/451] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:28 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:29.623343 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:29.624129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:29.634335 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:29.635078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:29.636115 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:29.636761 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:29.981819 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:29.993161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-87b9f0f7-9e79-4fbd-b85a-04143cc2a6b3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.374246 Jun 20 12:26:29.993755 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 224/452] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:29 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:31.010754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:31.011458 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:31.024955 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:31.024955 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:31.024955 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:31.024955 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:31.289091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:31.301958 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ec3e06b1-03bb-4b9d-9a13-94ff08dba599 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.295155 Jun 20 12:26:31.316699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 229/453] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:31 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:32.321529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:32.322274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:32.339429 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:32.339887 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:32.340718 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:32.341162 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:32.992397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:33.004001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-db9f6ed6-9cbc-48aa-916e-0077c5258fdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.686480 Jun 20 12:26:33.006235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 225/454] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:32 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:33.509514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a90477c9-4652-45ac-b5aa-4e28a2ef6ef0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:33.510963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a90477c9-4652-45ac-b5aa-4e28a2ef6ef0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:33.519865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a90477c9-4652-45ac-b5aa-4e28a2ef6ef0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.520432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a90477c9-4652-45ac-b5aa-4e28a2ef6ef0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.521332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a90477c9-4652-45ac-b5aa-4e28a2ef6ef0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.521918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a90477c9-4652-45ac-b5aa-4e28a2ef6ef0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.548969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a90477c9-4652-45ac-b5aa-4e28a2ef6ef0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671/ips" status: 200 len: 149 microversion: 2.1 time: 0.054923 Jun 20 12:26:33.550177 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 230/455] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:26:33 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:33.561662 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "055d6866-4537-4c50-9dae-83c791ba97f1"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:33.562921 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:33.569864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.570310 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.571067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.571668 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.666320 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Invalid volume: volume 055d6866-4537-4c50-9dae-83c791ba97f1 is already attached to instances: b954edf9-f964-4714-b270-e9f9ee51a80a Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: POST /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671/os-volume_attachments HTTP/1.1 Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 74 Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:26:33.668067 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {"volumeAttachment": {"volumeId": "055d6866-4537-4c50-9dae-83c791ba97f1"}} Jun 20 12:26:33.669441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Invalid volume: volume 055d6866-4537-4c50-9dae-83c791ba97f1 is already attached to instances: b954edf9-f964-4714-b270-e9f9ee51a80a Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'server_id': '723b236d-b42a-49bd-82e5-8cdbd77ae671', 'body': {'volumeAttachment': {'volumeId': '055d6866-4537-4c50-9dae-83c791ba97f1'}}} Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 055d6866-4537-4c50-9dae-83c791ba97f1 is already attached to instances: b954edf9-f964-4714-b270-e9f9ee51a80a Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:33.670313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 055d6866-4537-4c50-9dae-83c791ba97f1 is already attached to instances: b954edf9-f964-4714-b270-e9f9ee51a80a Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:33.672001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:33.673186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:33.673186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:33.673186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:33.673186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 055d6866-4537-4c50-9dae-83c791ba97f1 is already attached to instances: b954edf9-f964-4714-b270-e9f9ee51a80a Jun 20 12:26:33.673186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:33.673186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 400 to user: Invalid volume: volume 055d6866-4537-4c50-9dae-83c791ba97f1 is already attached to instances: b954edf9-f964-4714-b270-e9f9ee51a80a {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:33.673186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-be9ddc36-3ad3-4483-8f85-8afe3e1937c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112616 Jun 20 12:26:33.674364 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 226/456] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:26:33 2022] POST /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:26:33.684830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:33.690559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:33.698288 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.698824 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.699984 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:33.700715 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:33.738114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:34.025331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:34.026242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:34.034421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.035785 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.036756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.037363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.112653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7a78bb0f-ca9c-4528-8be2-7399971a96af tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 204 len: 0 microversion: 2.1 time: 0.428135 Jun 20 12:26:34.112653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 231/457] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:33 2022] DELETE /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:26:34.119211 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:34.121037 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:34.141337 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.143866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.146661 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:34.147214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:34.602997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:34.616530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1e484dfc-5a33-4eef-a349-22e9b01b47b5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.596436 Jun 20 12:26:34.617327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 227/458] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:34 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:34.768957 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:34.780276 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d4f94c75-15ef-4bc4-8d9d-1fdd0c0b778d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1680 microversion: 2.1 time: 0.666060 Jun 20 12:26:34.782661 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 232/459] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:34 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1680 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:35.634937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:35.636489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:35.649143 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=68 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:35.650801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.651260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.652045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.652482 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.803567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:35.803567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:35.813472 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.813953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.814958 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:35.815361 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:35.887944 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:35.902611 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-81531d56-400e-4171-a9ea-028e3956b0b4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.271785 Jun 20 12:26:35.903815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 228/460] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:35 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:36.162818 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:36.176610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e3d13e3b-bf80-41cd-9381-413c4f7b3d58 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1680 microversion: 2.1 time: 0.378267 Jun 20 12:26:36.177403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 233/461] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:35 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1680 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:36.925294 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:36.927945 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:36.939672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.939672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.940395 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:36.941078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:36.997190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:37.196777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:37.198362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:37.216595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:37.218044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:37.222004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:37.223203 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:37.372210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:37.390048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4ec66b11-ab19-41c9-9a92-bc318bd1c78e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1613 microversion: 2.1 time: 0.199180 Jun 20 12:26:37.390786 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 234/462] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:37 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1613 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:37.704641 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:37.715922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-03aaa043-79dc-4f71-befe-d74279f22534 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1676 microversion: 2.1 time: 0.797495 Jun 20 12:26:37.717940 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 229/463] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:36 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1676 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:37.915169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-fbdcd7f8-4d69-49c5-bdb9-eda10c0a81dd req-8deb8a5b-2b5f-442a-bfa0-bb2564bfa59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723b236d-b42a-49bd-82e5-8cdbd77ae671", "name": "network-vif-deleted", "tag": "ba5cd384-36f6-4125-957f-80c90a4cfa50"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:37.949533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fbdcd7f8-4d69-49c5-bdb9-eda10c0a81dd req-8deb8a5b-2b5f-442a-bfa0-bb2564bfa59d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:37.960391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fbdcd7f8-4d69-49c5-bdb9-eda10c0a81dd req-8deb8a5b-2b5f-442a-bfa0-bb2564bfa59d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:37.977781 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-fbdcd7f8-4d69-49c5-bdb9-eda10c0a81dd req-8deb8a5b-2b5f-442a-bfa0-bb2564bfa59d service nova] Creating event network-vif-deleted:ba5cd384-36f6-4125-957f-80c90a4cfa50 for instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 on hv-cinder-83697 Jun 20 12:26:37.989205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-fbdcd7f8-4d69-49c5-bdb9-eda10c0a81dd req-8deb8a5b-2b5f-442a-bfa0-bb2564bfa59d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078902 Jun 20 12:26:37.993595 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 230/464] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:26:38.250886 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-535c75bc-bb84-406a-8436-54adf2696a8a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Action: 'create', calling method: .version_select at 0x7fe2903408b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1645848315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiNkw5eoHOhgbE2BK/CFKjvxXfViHuEtVq8oizXI66YvoGK7UNIUvBk6nDVn+s+nSpIcwZWjna29U0zJXg7WkaaImPrfFtieecpJAYJpHTejPGkGrxobPjDD5REzNY5ZQ=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:38.289905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-535c75bc-bb84-406a-8436-54adf2696a8a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:26:38.295048 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-535c75bc-bb84-406a-8436-54adf2696a8a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for user 648c1ba14f1842a5b4160a7569e3206e and project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:26:38.409208 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:38.409923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:38.423897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-535c75bc-bb84-406a-8436-54adf2696a8a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.584437 Jun 20 12:26:38.424409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.424671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 235/465] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:26:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:38.430587 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.431536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.432682 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.536176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.536176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.536176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'fault' on Instance uuid 723b236d-b42a-49bd-82e5-8cdbd77ae671 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:38.677967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:38.696497 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f30cebea-0201-4357-8c53-a2d6f697dbce tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 200 len: 1331 microversion: 2.1 time: 0.290887 Jun 20 12:26:38.698898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 231/466] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:38 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 1331 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:38.735352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:38.735974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:38.755562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.756196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.757186 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:38.757626 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:38.762789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:39.120566 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:39.139982 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b4da0b77-e1dc-425b-a28d-4bfc94cbe015 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1653 microversion: 2.1 time: 0.404104 Jun 20 12:26:39.140640 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 236/467] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:38 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1653 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:39.170401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-33b18921-bcef-4909-a8f3-2bf1ef15bb63 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:39.178131 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33b18921-bcef-4909-a8f3-2bf1ef15bb63 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:39.178900 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-33b18921-bcef-4909-a8f3-2bf1ef15bb63 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:39.216772 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-33b18921-bcef-4909-a8f3-2bf1ef15bb63 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Going to try to start instance {{(pid=118092) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 12:26:39.473855 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-33b18921-bcef-4909-a8f3-2bf1ef15bb63 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action" status: 202 len: 0 microversion: 2.1 time: 0.314557 Jun 20 12:26:39.474466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 232/468] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:26:39 2022] POST /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:39.489021 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:39.489658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:39.512241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:39.512961 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:39.514544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:39.519233 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:39.719485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:39.720470 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:39.738336 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:39.739864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:39.746016 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:39.746589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:39.782533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 HTTP/1.1 Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:26:39.790621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:26:39.792171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '723b236d-b42a-49bd-82e5-8cdbd77ae671'} Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:39.793060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:26:39.794530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:26:39.795629 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:39.795629 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9ddfadde-891c-4992-80e5-80ff106f5c4d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 404 len: 111 microversion: 2.1 time: 0.082070 Jun 20 12:26:39.798727 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 233/469] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:39 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:26:39.807132 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3e067034-1d28-46a5-9b5e-e6b852188588 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '.version_select at 0x7fe2912663a0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:39.985662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:39.985662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-493c27e1-b271-4925-8c30-3b50441ba775 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1662 microversion: 2.1 time: 0.475945 Jun 20 12:26:39.985662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 237/470] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:39 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1662 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:40.089258 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3e067034-1d28-46a5-9b5e-e6b852188588 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315440575" status: 202 len: 0 microversion: 2.1 time: 0.286170 Jun 20 12:26:40.090033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 234/471] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 20 12:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315440575 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:26:40.972919 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:40.974173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:40.984771 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:40.988565 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:40.989606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:40.990262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:41.241674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:41.257368 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5a69c220-4406-445e-bce9-c60da41cc968 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1662 microversion: 2.1 time: 0.288364 Jun 20 12:26:41.265755 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 238/472] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:40 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1662 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:41.787449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:41.787947 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:41.812164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.814922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:41.814922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:41.817877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.024728 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'services' on Instance uuid b954edf9-f964-4714-b270-e9f9ee51a80a {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:42.275024 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:42.275634 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:42.291742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.292199 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.292984 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.293419 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.323896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-59cb0ef9-4dde-4cde-afc7-ea57f3bc2ae1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments/055d6866-4537-4c50-9dae-83c791ba97f1" status: 202 len: 0 microversion: 2.1 time: 0.553434 Jun 20 12:26:42.324651 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 235/473] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:26:41 2022] DELETE /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments/055d6866-4537-4c50-9dae-83c791ba97f1 => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:42.358091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c87fc621-3682-4e75-aee0-e5f698b780ea tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:42.360007 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c87fc621-3682-4e75-aee0-e5f698b780ea tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:42.375718 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c87fc621-3682-4e75-aee0-e5f698b780ea tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.378001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c87fc621-3682-4e75-aee0-e5f698b780ea tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.378938 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c87fc621-3682-4e75-aee0-e5f698b780ea tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:42.383250 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c87fc621-3682-4e75-aee0-e5f698b780ea tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:42.438631 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c87fc621-3682-4e75-aee0-e5f698b780ea tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108570 Jun 20 12:26:42.442998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 236/474] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:26:42 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:26:42.565320 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:42.587694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-18e8afd4-4071-4d92-bc4d-611dc1ecca90 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1662 microversion: 2.1 time: 0.312891 Jun 20 12:26:42.587694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 239/475] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:42 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1662 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:43.452836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-723d890f-1427-49d7-be4d-e676afdfb98d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:43.453424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-723d890f-1427-49d7-be4d-e676afdfb98d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:43.460513 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-723d890f-1427-49d7-be4d-e676afdfb98d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:43.461041 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-723d890f-1427-49d7-be4d-e676afdfb98d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:43.461924 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-723d890f-1427-49d7-be4d-e676afdfb98d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:43.462575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-723d890f-1427-49d7-be4d-e676afdfb98d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:43.494353 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-723d890f-1427-49d7-be4d-e676afdfb98d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047087 Jun 20 12:26:43.502925 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 237/476] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:26:43 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:43.605453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:43.606238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:43.614364 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:43.615212 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:43.616311 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:43.616926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:43.834575 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:43.855078 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8492d7b4-6ced-4546-b975-34daa27ddef3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1666 microversion: 2.1 time: 0.253390 Jun 20 12:26:43.855665 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 240/477] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:43 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1666 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:44.508822 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-34e27a77-a117-4215-a9c3-dfff7af43020 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:44.510219 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-34e27a77-a117-4215-a9c3-dfff7af43020 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:44.518734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34e27a77-a117-4215-a9c3-dfff7af43020 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.519183 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34e27a77-a117-4215-a9c3-dfff7af43020 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:44.519966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34e27a77-a117-4215-a9c3-dfff7af43020 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.520396 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34e27a77-a117-4215-a9c3-dfff7af43020 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:44.555955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-34e27a77-a117-4215-a9c3-dfff7af43020 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051090 Jun 20 12:26:44.561736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 238/478] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:26:44 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:26:44.643112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:44.643112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:44.657719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.658207 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:44.659555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:44.660117 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:44.694981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:26:45.015455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-403c93ea-e375-4fc4-8d2d-06e45c5341d1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 204 len: 0 microversion: 2.1 time: 0.378064 Jun 20 12:26:45.016441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 241/479] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:26:44 2022] DELETE /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:26:45.025139 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:45.025883 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:45.033201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.033775 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.034677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:45.035188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:45.331677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:45.374676 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bab2f435-1881-4ffb-91cd-a3c6cf3cc7ed tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1681 microversion: 2.1 time: 0.324259 Jun 20 12:26:45.375561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 239/480] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:45 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:26:46.393538 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:46.394356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:46.400695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:46.401155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:46.401981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:46.402427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:46.589041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:46.600090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a7a8487d-2c20-483d-8a98-dd99cba875f5 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1681 microversion: 2.1 time: 0.211163 Jun 20 12:26:46.600854 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 242/481] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:46 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:47.620885 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:47.622684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:47.638035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:47.640230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:47.643351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:47.643351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:47.937218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:47.951144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b1df4c5c-3d09-472f-9e64-499e1355793f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1681 microversion: 2.1 time: 0.336325 Jun 20 12:26:47.962878 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 240/482] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:47 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1681 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:48.688554 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-08579e0f-2ccd-4de1-869f-1c044cf68872 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74798891-09e8-434a-935d-dc71b842aff3", "device": "/dev/sdb"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:48.690490 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-08579e0f-2ccd-4de1-869f-1c044cf68872 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:48.706079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=4 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:48.710374 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:48.714072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-08579e0f-2ccd-4de1-869f-1c044cf68872 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:48.718447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-08579e0f-2ccd-4de1-869f-1c044cf68872 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:48.719948 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-08579e0f-2ccd-4de1-869f-1c044cf68872 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:48.721484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-08579e0f-2ccd-4de1-869f-1c044cf68872 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:48.874697 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-c2b5a55f-2ebe-4b7e-8d54-3781ed549d91 req-86dfe1ab-a3fd-4a74-84b0-765b5611e2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b954edf9-f964-4714-b270-e9f9ee51a80a", "name": "network-vif-deleted", "tag": "cd7e676c-79aa-4b40-999b-85ed6d43f711"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:48.914353 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-c2b5a55f-2ebe-4b7e-8d54-3781ed549d91 req-86dfe1ab-a3fd-4a74-84b0-765b5611e2bc service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:48.915466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-c2b5a55f-2ebe-4b7e-8d54-3781ed549d91 req-86dfe1ab-a3fd-4a74-84b0-765b5611e2bc service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:48.937369 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-c2b5a55f-2ebe-4b7e-8d54-3781ed549d91 req-86dfe1ab-a3fd-4a74-84b0-765b5611e2bc service nova] Creating event network-vif-deleted:cd7e676c-79aa-4b40-999b-85ed6d43f711 for instance b954edf9-f964-4714-b270-e9f9ee51a80a on hv-cinder-83697 Jun 20 12:26:48.944549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-c2b5a55f-2ebe-4b7e-8d54-3781ed549d91 req-86dfe1ab-a3fd-4a74-84b0-765b5611e2bc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082635 Jun 20 12:26:48.945714 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 241/483] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:26:48.986140 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:48.986872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:49.031008 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.031511 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.032603 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:49.058830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:49.140688 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:49.164029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bfb4f996-e487-4627-81db-6a737550deb2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1613 microversion: 2.1 time: 0.191330 Jun 20 12:26:49.174498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 242/484] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:48 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1613 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:49.790009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-08579e0f-2ccd-4de1-869f-1c044cf68872 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "POST /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.105542 Jun 20 12:26:49.790942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 243/485] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:26:48 2022] POST /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16/os-volume_attachments => generated 194 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:50.183110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:50.184130 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:50.222323 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:50.224147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:50.227361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:50.228034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:50.334849 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:50.335730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:50.336552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'fault' on Instance uuid b954edf9-f964-4714-b270-e9f9ee51a80a {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:26:50.403302 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:50.414750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-80462b5c-6522-4ff9-9958-b13c9b31229e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 200 len: 1330 microversion: 2.1 time: 0.235026 Jun 20 12:26:50.426274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 243/486] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:50 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 1330 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:51.433484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:51.434274 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:51.442278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:51.443024 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:51.444049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:51.444691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:51.462049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a HTTP/1.1 Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:26:51.464314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:26:51.465669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'b954edf9-f964-4714-b270-e9f9ee51a80a'} Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:26:51.467133 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:26:51.468619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:26:51.470694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:26:51.471719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3ed78a28-ba1c-43d2-9d94-66127fd1553f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 404 len: 111 microversion: 2.1 time: 0.042815 Jun 20 12:26:51.472501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 244/487] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:51 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:26:51.480666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8619b106-4953-49a4-9ac1-c6ca5a4066fa tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '.version_select at 0x7fe2914c58b0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:51.567230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8619b106-4953-49a4-9ac1-c6ca5a4066fa tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-494182752" status: 202 len: 0 microversion: 2.1 time: 0.090271 Jun 20 12:26:51.568247 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 244/488] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jun 20 12:26:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-494182752 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:26:52.551442 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-934d2915-69a6-483e-9253-7a2bfbb6c34a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: .version_select at 0x7fe29024fca0>, body: {"keypair": {"name": "tempest-keypair-1161976094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0bwrieZmNm8mTsHneR51zrR+jtY211LPfS2YHJ4Oz5FnvFPzAI005HQ5cBrDG/eXxzqohNJvD5IU6e88/iSmIdThMPvQKoHeSsnWRpmbHANvwtJ5yNqxCGzb7TZgrMTg=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:52.577300 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-934d2915-69a6-483e-9253-7a2bfbb6c34a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:26:52.581218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-934d2915-69a6-483e-9253-7a2bfbb6c34a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:26:52.649653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-934d2915-69a6-483e-9253-7a2bfbb6c34a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102432 Jun 20 12:26:52.656643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 245/489] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:26:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:56.119724 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1478949439", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ad919b-444d-4364-9171-7dcb6a499f3f"}], "security_groups": [{"name": "tempest-securitygroup--187631628"}], "key_name": "tempest-keypair-1161976094", "user_data": "}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:57.155151 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] validate_networks() for [('25ad919b-444d-4364-9171-7dcb6a499f3f', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:26:57.593770 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:26:57.594223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:26:57.594696 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:26:57.595103 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:26:57.595511 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:26:57.605118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:57.605571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:57.606437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:57.606880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:57.626594 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:26:57.630634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:26:57.643066 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:26:57.645448 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:26:57.918943 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c3a789d7-0631-4d6b-93f8-d0bf9629f3d7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.803608 Jun 20 12:26:57.923354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 245/490] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:26:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:26:57.933111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-05f6a2e4-3632-4df8-9d6a-8d3455e71675 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:57.933763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-05f6a2e4-3632-4df8-9d6a-8d3455e71675 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:57.997293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-05f6a2e4-3632-4df8-9d6a-8d3455e71675 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:58.005573 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-05f6a2e4-3632-4df8-9d6a-8d3455e71675 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1242 microversion: 2.1 time: 0.078213 Jun 20 12:26:58.006165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 246/491] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:57 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:59.024703 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:26:59.025953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:26:59.034349 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:59.034836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:59.035625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:26:59.036065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:26:59.140889 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:26:59.148772 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-38fc2b7a-f37a-4d7a-bbd6-c70acdd00e88 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1246 microversion: 2.1 time: 0.128106 Jun 20 12:26:59.149348 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 246/492] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:26:59 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:26:59.392502 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-52a7524a-778c-4699-80d0-c9707c89b1fa tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Action: 'create', calling method: .version_select at 0x7fe29025f1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-774552932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/zR/Uq8aW/2NCcJmQBuZv1KMZWK9hPTfD22iC466+NBKY0JhbbucrHlrb6SaNNOjWDWhyfWVXI2exKqUxKrDNLxHB+qVNka2Ev1wnRS6hfbQF+5y7NqeKvqc3/nKdC6w=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:59.408704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-52a7524a-778c-4699-80d0-c9707c89b1fa tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Getting quotas for project 7a033c0ad5484ff89949482c587ea5e7. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:26:59.412681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-52a7524a-778c-4699-80d0-c9707c89b1fa tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Getting quotas for user 4c0fe72487114f47ad7944b05d3698b1 and project 7a033c0ad5484ff89949482c587ea5e7. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:26:59.496382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-52a7524a-778c-4699-80d0-c9707c89b1fa tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.108050 Jun 20 12:26:59.497306 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 247/493] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:26:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:26:59.550206 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-969253079", "imageRef": "0bdd662d-f99b-4658-a514-7fab3c30c831", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-774552932", "networks": [{"uuid": "cc8b0014-9551-4b0d-a5f2-503ea319e37c"}]}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:26:59.601131 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] validate_networks() for [('cc8b0014-9551-4b0d-a5f2-503ea319e37c', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:00.166554 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:00.176795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:00.176795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:00.176795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:00.176795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:00.177144 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:00.237058 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:00.244608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-554db64f-c407-4351-a978-9e4ae7c82be2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1294 microversion: 2.1 time: 0.081902 Jun 20 12:27:00.245179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 248/494] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:00 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:00.252459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:27:00.252984 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:27:00.253334 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:27:00.253768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:27:00.254199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:27:00.263078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:00.263520 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:00.264318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:00.264750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:00.281011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Getting quotas for project 7a033c0ad5484ff89949482c587ea5e7. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:00.285029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Getting quotas for user 4c0fe72487114f47ad7944b05d3698b1 and project 7a033c0ad5484ff89949482c587ea5e7. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:00.296513 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:27:00.299157 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0bdd662d-f99b-4658-a514-7fab3c30c831',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:27:00.421238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fe655a59-2993-4a88-9fa7-0e63ec4042e8 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875765 Jun 20 12:27:00.422739 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 247/495] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:26:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:27:00.432508 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b5de84a1-37cd-450a-9092-5e77b8115d7e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:00.433120 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b5de84a1-37cd-450a-9092-5e77b8115d7e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:00.486418 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b5de84a1-37cd-450a-9092-5e77b8115d7e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:00.493016 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b5de84a1-37cd-450a-9092-5e77b8115d7e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1257 microversion: 2.1 time: 0.064387 Jun 20 12:27:00.493579 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 249/496] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:00 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1257 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:01.263395 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:01.264009 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:01.271725 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:01.275582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:01.275582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:01.275582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:01.338989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:01.346601 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9581cee4-f2d9-4c77-8fc5-a6d550f1f6b0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1294 microversion: 2.1 time: 0.087677 Jun 20 12:27:01.347165 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 248/497] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:01 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:01.510109 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-83d19c21-6585-4c9e-bc1f-fc8e5b39260e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:01.510724 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-83d19c21-6585-4c9e-bc1f-fc8e5b39260e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:01.567195 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-83d19c21-6585-4c9e-bc1f-fc8e5b39260e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:01.574018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-83d19c21-6585-4c9e-bc1f-fc8e5b39260e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1257 microversion: 2.1 time: 0.067782 Jun 20 12:27:01.574518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 250/498] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:01 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:02.363708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:02.364351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:02.370393 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:02.370841 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:02.371607 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:02.372041 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:02.376788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:02.436190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:02.444714 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-01a65d9d-1865-4ee5-b97e-94f8ff3364a3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1294 microversion: 2.1 time: 0.086026 Jun 20 12:27:02.445274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 249/499] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:02 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:02.590832 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:02.591364 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:02.598453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:02.598902 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:02.599664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:02.600101 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:02.659752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:02.667095 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c463981b-3c8f-4d17-b407-856f632f6d1c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1261 microversion: 2.1 time: 0.080196 Jun 20 12:27:02.667656 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 251/500] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:02 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:03.462555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:03.463206 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:03.471554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.472057 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.472839 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.473298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.563847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:03.571482 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-282aa9af-cca6-4b84-a831-a25fa1a7a8de tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1302 microversion: 2.1 time: 0.113503 Jun 20 12:27:03.572044 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 250/501] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:03 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1302 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:03.684670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:03.685214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:03.692317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.692768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.693542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:03.694014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:03.772738 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:03.780679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e59945cf-004a-49de-ac25-a01313aaeb75 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1253 microversion: 2.1 time: 0.100046 Jun 20 12:27:03.781925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 252/502] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:03 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1253 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:04.589330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:04.589973 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:04.596624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:04.597069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:04.597854 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:04.598288 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:04.724386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:04.731719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-726182b1-5f2d-43b4-9bd6-77c8537bcc8f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.146198 Jun 20 12:27:04.732270 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 251/503] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:04 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:04.808220 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:04.808837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:04.816074 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:04.816530 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:04.817302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:04.817765 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:04.880289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:04.887782 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-52bf3b9e-1d4f-4562-a2a9-784466340614 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1309 microversion: 2.1 time: 0.083419 Jun 20 12:27:04.888350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 253/504] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:04 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1309 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:05.749241 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:05.749861 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:05.757202 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:05.757644 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:05.758437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:05.758866 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:05.891271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:05.899669 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b01eef3e-1d92-4d22-8b25-fca1bfb13556 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.154254 Jun 20 12:27:05.900231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 252/505] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:05 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:05.904413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:05.905047 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:05.912012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:05.912459 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:05.913227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:05.913664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:05.979175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:05.988116 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-667bb5a2-9786-43fe-9fa8-2fd03d59a37f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1309 microversion: 2.1 time: 0.087247 Jun 20 12:27:05.988394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 254/506] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:05 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:06.916803 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:06.917336 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:06.919614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:06.925456 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:06.925911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:06.926670 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:06.927099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:07.009840 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:07.010479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:07.018827 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:07.019413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:07.020316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:07.020865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:07.039662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:07.067350 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:07.075832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b35c11c9-2fd5-4a66-b767-7aed8dab871e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.162895 Jun 20 12:27:07.076401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 253/507] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:06 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:07.084914 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:07.092326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e26e662a-ed68-423b-b4d4-dca887705827 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1309 microversion: 2.1 time: 0.091743 Jun 20 12:27:07.092879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 255/508] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:06 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:07.941184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-b2d12f76-7f88-4fac-96fb-2feece652476 req-ebaf0ac9-41bb-4bc6-86d7-956e86dbdcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46973eb-c676-4cd1-9b9b-5e4a2943c518", "tag": "ead77c80-977e-4a4c-904f-7d880c8e28a3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:07.955836 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b2d12f76-7f88-4fac-96fb-2feece652476 req-ebaf0ac9-41bb-4bc6-86d7-956e86dbdcf9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:07.956418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b2d12f76-7f88-4fac-96fb-2feece652476 req-ebaf0ac9-41bb-4bc6-86d7-956e86dbdcf9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:07.968564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-b2d12f76-7f88-4fac-96fb-2feece652476 req-ebaf0ac9-41bb-4bc6-86d7-956e86dbdcf9 service nova] Creating event network-changed:ead77c80-977e-4a4c-904f-7d880c8e28a3 for instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 on hv-cinder-83697 Jun 20 12:27:07.975449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-b2d12f76-7f88-4fac-96fb-2feece652476 req-ebaf0ac9-41bb-4bc6-86d7-956e86dbdcf9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044843 Jun 20 12:27:07.976053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 254/509] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:08.093482 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:08.095206 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:08.111818 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:08.112288 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.112969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:08.114506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.116533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.117779 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.126242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.127540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.130121 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:08.131717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:08.265483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:08.274326 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2dbe8176-1bf9-4d05-a647-98f3b3abb7f7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1315 microversion: 2.1 time: 0.168209 Jun 20 12:27:08.274952 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 255/510] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:08 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:08.582313 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:08.590940 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e88b6229-c93c-40a2-a1f4-3637e947e212 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.502278 Jun 20 12:27:08.591742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 256/511] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:08 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:08.945218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-471731918", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1645848315", "security_groups": [{"name": "tempest-secgroup-smoke-2047174386"}], "block_device_mapping_v2": [{"uuid": "01c4cbe9-9e6f-4d5f-98a1-11f7d37184da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7bf56be-1d96-4e0f-a5ab-753fc0e58582"}]}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:09.098329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] validate_networks() for [('f7bf56be-1d96-4e0f-a5ab-753fc0e58582', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:09.292857 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:09.294371 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:09.301939 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.302475 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.303704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.304425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.458882 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:09.467508 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-07211f24-1ee3-4d6f-98b8-60d4863b0d0e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.178707 Jun 20 12:27:09.468809 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 257/512] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:09 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:09.516724 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:27:09.517828 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:27:09.518308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:27:09.518802 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:27:09.519270 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:27:09.529287 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.529741 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.530585 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.531027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.549083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:09.554360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for user 648c1ba14f1842a5b4160a7569e3206e and project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:09.608233 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:09.608853 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:09.618556 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.619495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.624794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:09.625428 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:09.628503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:27:09.635021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01c4cbe9-9e6f-4d5f-98a1-11f7d37184da',volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:27:09.776575 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:09.785243 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ee1d10e2-3b6e-4aa5-9544-3d1a8ae88f44 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.180827 Jun 20 12:27:09.789064 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 258/513] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:09 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:10.103032 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-caebf6ac-d023-4240-819b-622c23cb8d61 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.164360 Jun 20 12:27:10.106428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 256/514] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:27:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:27:10.115946 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-82936796-ac5e-4a13-a922-8f2494f35758 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:10.116562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-82936796-ac5e-4a13-a922-8f2494f35758 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:10.171481 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-82936796-ac5e-4a13-a922-8f2494f35758 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:10.179155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-82936796-ac5e-4a13-a922-8f2494f35758 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1094 microversion: 2.1 time: 0.068647 Jun 20 12:27:10.181276 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 259/515] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:10 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:10.485773 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:10.486704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:10.493432 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:10.494155 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:10.494965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:10.495763 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:10.645673 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:10.653972 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1f8dee73-5ef0-41c6-a149-27868f09c079 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.172751 Jun 20 12:27:10.654548 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 257/516] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:10 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:10.802476 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:10.803332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:10.810182 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:10.810617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:10.811381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:10.811813 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:10.959514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:10.967985 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-66ad8de9-e20c-4bab-9f04-8755c5933895 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.169443 Jun 20 12:27:10.968716 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 260/517] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:10 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:11.197734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:11.198432 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:11.207272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.207722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.208509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.208944 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.288440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:11.304302 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-360bcd4e-9f4e-4e57-b8a6-5b8c12639a46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1144 microversion: 2.1 time: 0.110683 Jun 20 12:27:11.305588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 258/518] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:11 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1144 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:11.672286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:11.673000 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:11.680083 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.680892 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.681821 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.682380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:11.825606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:11.833482 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c3145491-a4f7-44e6-baf8-767a56150b0a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.165185 Jun 20 12:27:11.834091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 261/519] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:11 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:11.985333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:11.986603 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:11.992935 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:11.993681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.010388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.011138 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.155919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:12.163833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-173e1073-3c25-4dfa-a166-1f515a9adafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.182444 Jun 20 12:27:12.164407 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 259/520] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:11 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:12.331812 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:12.332477 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:12.338623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.339073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.342817 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.343278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.405966 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:12.413662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-91e0998e-303b-49b8-ac32-fc3a5aa42f68 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1144 microversion: 2.1 time: 0.088557 Jun 20 12:27:12.414325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 262/521] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:12 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:12.849777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:12.850622 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:12.857103 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.857602 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:12.862012 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:12.862012 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:13.018663 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:13.033720 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f040f7ee-aaa1-4535-be42-637db088fb42 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.186733 Jun 20 12:27:13.034476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 260/522] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:12 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:13.181256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:13.182038 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:13.189023 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:13.189607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:13.190308 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:13.190743 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:13.352529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:13.359010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0c9b7543-4741-46bf-9683-17f8df689ae9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.181957 Jun 20 12:27:13.360220 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 263/523] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:13 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:13.430463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:13.431087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:13.437074 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:13.437452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:13.438224 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:13.438654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:13.504376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:13.512910 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-26f880d2-732a-4ad1-ac6a-1cc5ba994481 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1144 microversion: 2.1 time: 0.086351 Jun 20 12:27:13.524580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 261/524] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:13 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:14.051094 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:14.051991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:14.059234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.059941 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.060940 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.061432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.221607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:14.229430 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f535d1bc-b205-4a25-9a43-b210e02466cc tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.182533 Jun 20 12:27:14.230029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 264/525] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:14 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:14.377170 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:14.377970 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:14.386136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.386590 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.387613 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.388077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.532923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:14.533347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:14.534121 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:14.540502 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.540800 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-df5b3576-fcd7-4f47-8ca6-c6504ba61827 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.168232 Jun 20 12:27:14.540949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.541381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 262/526] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:14 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:14.541794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:14.542324 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:14.608218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:14.615993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-69829ca9-2df2-41c6-afa4-fdc733cffb3b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1144 microversion: 2.1 time: 0.086916 Jun 20 12:27:14.621844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 265/527] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:14 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:15.247578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:15.248199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:15.255421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.259832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.259832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.259832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.270995 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-386280ce-10d2-4150-ae13-f2b282d8f5c6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6ea35cb-2be8-4d59-9dfb-93462f7b0895"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:15.272234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-386280ce-10d2-4150-ae13-f2b282d8f5c6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:15.278825 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386280ce-10d2-4150-ae13-f2b282d8f5c6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.279499 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386280ce-10d2-4150-ae13-f2b282d8f5c6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.280455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386280ce-10d2-4150-ae13-f2b282d8f5c6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.281067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-386280ce-10d2-4150-ae13-f2b282d8f5c6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.415476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:15.423818 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9450475f-a30b-4dff-a332-bfed61694511 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.180143 Jun 20 12:27:15.424797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 263/528] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:15 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:15.559027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:15.559630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:15.566232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.566958 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.567746 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.568186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.709386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:15.718500 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-14bc210d-89c6-424d-b070-09a330af241e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.163296 Jun 20 12:27:15.719093 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 264/529] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:15 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:15.723932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:15.724541 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:15.731330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.731775 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.732563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:15.732997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:15.798333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:15.806045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-32b30638-737f-456c-8264-1849ab5be6be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1144 microversion: 2.1 time: 0.085931 Jun 20 12:27:15.806675 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 265/530] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:15 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:16.441569 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:16.442361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:16.449457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.450104 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:16.450989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.451597 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:16.601415 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:16.609413 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-307b2fc0-9546-4951-ac02-cf8e54e93c0f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.172809 Jun 20 12:27:16.610168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 266/531] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:16 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:16.739471 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:16.740118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:16.748117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.748713 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:16.749561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.750111 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:16.754812 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:16.892947 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:16.900998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-29edd0dd-b4a3-43ad-8ce8-42676b50291f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.168894 Jun 20 12:27:16.901708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 267/532] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:16 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:16.906295 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:16.906922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:16.913391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.913870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:16.914745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:16.915183 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:16.979954 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:16.988365 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8482e0b5-8c01-4f06-9da0-875b989c5756 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1144 microversion: 2.1 time: 0.085515 Jun 20 12:27:16.989233 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 268/533] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:16 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:17.565066 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:17.565749 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:17.572774 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:17.573172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:17.573980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:17.574417 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:17.665834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lazy-loading 'services' on Instance uuid 1ffe781f-e20e-44ed-b2ee-98a480b22e16 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:27:17.853751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4228e1d6-7d09-4557-9191-dff05d16dbd2 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16/os-volume_attachments/74798891-09e8-434a-935d-dc71b842aff3" status: 202 len: 0 microversion: 2.1 time: 0.292368 Jun 20 12:27:17.854454 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 269/534] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:27:17 2022] DELETE /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16/os-volume_attachments/74798891-09e8-434a-935d-dc71b842aff3 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:27:17.859278 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:17.859967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:17.866744 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:17.867186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:17.867953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:17.868381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.028778 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:18.035079 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f3a33d84-27c6-4843-a497-96ba83c574c0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.179693 Jun 20 12:27:18.035644 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 270/535] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:17 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:18.040182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:18.040789 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:18.046545 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:18.047019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.047782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:18.048722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.188292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:18.197071 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3bca52fc-aa05-4d55-be4b-c07ab3aae3ef tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.160411 Jun 20 12:27:18.198257 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 271/536] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:18 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:18.203638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:18.204328 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:18.210782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:18.215299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.215299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:18.215299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:18.274056 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:18.281658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ed5e0a40-c0fb-4f7a-9602-076e51cc4cdd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1144 microversion: 2.1 time: 0.081604 Jun 20 12:27:18.282247 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 272/537] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:18 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:19.052528 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:19.053248 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:19.059921 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.060449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.061408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.062100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.210709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:19.221576 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a69b9f16-ff5e-4cea-98c1-c0a6a4a4305f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.173579 Jun 20 12:27:19.222296 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 273/538] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:19 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:19.232691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:19.233332 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:19.249936 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.249936 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.249936 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.249936 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.506077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:19.513752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1608919a-e282-4e74-af18-60c7e1246a9e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.285029 Jun 20 12:27:19.514461 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 274/539] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:19 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:19.519681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:19.520696 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:19.528308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.532877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.532877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.532877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.550784 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=6 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:19.566949 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=18 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:19.630207 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:19.643094 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-386280ce-10d2-4150-ae13-f2b282d8f5c6 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.369972 Jun 20 12:27:19.643094 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 266/540] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:27:15 2022] POST /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 194 bytes in 4372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:19.643655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8bfce684-d6ac-4651-af56-112b412b5150 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1192 microversion: 2.1 time: 0.125242 Jun 20 12:27:19.643655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 275/541] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:19 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1192 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:19.656119 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-4fb7b2cb-c4cf-42a7-8ed9-8200b02dd177 req-94588a6d-402b-4b39-b983-7478ee3da190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50771-1643-4ddb-9375-6e52b0789270", "tag": "aeb492a1-b6de-465b-b91f-a1ad04692797"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:19.673144 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:19.676670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-4fb7b2cb-c4cf-42a7-8ed9-8200b02dd177 req-94588a6d-402b-4b39-b983-7478ee3da190 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:19.677290 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-4fb7b2cb-c4cf-42a7-8ed9-8200b02dd177 req-94588a6d-402b-4b39-b983-7478ee3da190 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:19.698119 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-4fb7b2cb-c4cf-42a7-8ed9-8200b02dd177 req-94588a6d-402b-4b39-b983-7478ee3da190 service nova] Creating event network-changed:aeb492a1-b6de-465b-b91f-a1ad04692797 for instance 99c50771-1643-4ddb-9375-6e52b0789270 on hv-cinder-83697 Jun 20 12:27:19.705432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-4fb7b2cb-c4cf-42a7-8ed9-8200b02dd177 req-94588a6d-402b-4b39-b983-7478ee3da190 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064391 Jun 20 12:27:19.706699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 267/542] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:20.063680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:20.065389 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:20.072164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.072606 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.073363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.073809 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.099526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:20.238949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:20.239646 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:20.242181 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=16 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:20.247774 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.248224 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.248991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.249427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.383692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:20.391527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c9645202-bd4f-4fad-829d-69d6538ec852 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.157446 Jun 20 12:27:20.392093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 268/543] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:20 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:20.400345 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e06a7fee-28df-4c0c-b09f-e189c9ec52ec tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 204 len: 0 microversion: 2.1 time: 0.341393 Jun 20 12:27:20.400931 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 276/544] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:20 2022] DELETE /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:27:20.409470 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:20.410104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:20.416596 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.419450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.419450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.419450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.533283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:20.534381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:20.540579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.541036 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.541824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.542670 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.547420 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:20.556153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1b27cdd1-1ff0-4924-81a9-4968b5262139 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1559 microversion: 2.1 time: 0.151106 Jun 20 12:27:20.556730 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 269/545] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:20 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:20.661953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:20.662595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:20.668795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.669248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.670059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:20.670501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:20.670616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:20.679353 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-04b8f7eb-1f31-42ad-8f5c-af66d878b670 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.150814 Jun 20 12:27:20.679919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 277/546] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:20 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:20.737838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:20.745308 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3d3eb9c6-7101-4df8-b884-96a730707106 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1192 microversion: 2.1 time: 0.089197 Jun 20 12:27:20.746010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 270/547] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:20 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:21.408141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:21.408975 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:21.415702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.416194 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.416967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.417404 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.552646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:21.560281 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c644576e-35b7-4bd7-8e24-99f71e3bd9f4 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.156130 Jun 20 12:27:21.561090 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 278/548] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:21 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:21.573619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:21.574342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:21.580549 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.580989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.581752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.582213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.696563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:21.697179 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:21.704798 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.705226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.706025 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.706459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.718676 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:21.727933 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-45093120-35aa-4eb5-9d2d-eeedc08b8fcc tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1513 microversion: 2.1 time: 0.158139 Jun 20 12:27:21.728524 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 271/549] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:21 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:21.762132 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:21.762742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:21.769022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.769460 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.770262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:21.770708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:21.791815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:21.837434 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:21.839906 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:21.845865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6938a91b-b787-4eb6-96fd-1ad6ebb3510e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1200 microversion: 2.1 time: 0.087221 Jun 20 12:27:21.847501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 272/550] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:21 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:21.847623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-311a864f-d127-428e-9cd8-e1ed1fd58fca tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.154911 Jun 20 12:27:21.848098 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 279/551] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:21 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:22.578641 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:22.579252 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:22.586032 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.586484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.587247 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.587680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.720115 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:22.728097 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7b854875-053b-455b-be21-c15e2bf390f5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.153739 Jun 20 12:27:22.728664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 273/552] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:22 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:22.745750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:22.746386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:22.752649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.753092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.753868 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.754305 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.864870 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:22.865329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:22.871618 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.872977 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.872977 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.873161 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.945420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:22.946504 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:22.957449 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-33e34aee-033f-498d-aac6-86d9cbe979f5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1200 microversion: 2.1 time: 0.097084 Jun 20 12:27:22.958261 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 274/553] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:22 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:22.960442 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-56168542-5352-497f-9918-72557fc6b6d4 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1513 microversion: 2.1 time: 0.218442 Jun 20 12:27:22.969642 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 280/554] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:22 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:22.973945 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:22.974578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:22.980651 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.981104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:22.981913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:22.982355 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.192755 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:23.200652 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-86aca63f-9aa0-40ef-acc4-6f912a7169ae tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.241589 Jun 20 12:27:23.201332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 275/555] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:22 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:23.745735 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:23.746360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:23.755422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.756163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.757136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.757741 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.784680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:23.904512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:23.914851 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-454d8611-5dd2-4a5b-a563-3f695cc871ea tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.173070 Jun 20 12:27:23.915425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 281/556] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:23 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:23.974949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:23.976406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:23.979401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:23.980032 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:23.983944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.995842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.995842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.995842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.996231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.996231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:23.996231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:23.996231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:24.234847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:24.245099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4f7490ba-7d74-4d87-8998-7d2e24f32eec tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.274066 Jun 20 12:27:24.245689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 276/557] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:23 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:24.251805 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:24.252621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:24.260348 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:24.261172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:24.261787 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:24.262785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:24.354029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:24.364701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c066c632-3244-41b0-a4ba-777f050dcaff tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1513 microversion: 2.1 time: 0.391580 Jun 20 12:27:24.365550 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 282/558] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:23 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1513 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:24.472058 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:24.480777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d75d6919-51b9-4d82-b1c9-152ff44ac9eb tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.233162 Jun 20 12:27:24.482292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 277/559] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:24 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:24.932457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:24.933766 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:24.942338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:24.943083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:24.943884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:24.944488 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.028316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-ff26a581-2a99-46b8-8bab-c18bd3db4ac6 req-aa07ee4e-e195-4c4d-93bb-503c590337ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36070a3e-9c08-45f3-a574-2412cabfe0ed", "tag": "53e7a966-d8ba-4ea1-befa-d940c1785d69"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:25.046370 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-ff26a581-2a99-46b8-8bab-c18bd3db4ac6 req-aa07ee4e-e195-4c4d-93bb-503c590337ef service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.048666 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-ff26a581-2a99-46b8-8bab-c18bd3db4ac6 req-aa07ee4e-e195-4c4d-93bb-503c590337ef service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.074340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-ff26a581-2a99-46b8-8bab-c18bd3db4ac6 req-aa07ee4e-e195-4c4d-93bb-503c590337ef service nova] Creating event network-changed:53e7a966-d8ba-4ea1-befa-d940c1785d69 for instance 36070a3e-9c08-45f3-a574-2412cabfe0ed on hv-cinder-83697 Jun 20 12:27:25.081146 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-ff26a581-2a99-46b8-8bab-c18bd3db4ac6 req-aa07ee4e-e195-4c4d-93bb-503c590337ef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056343 Jun 20 12:27:25.081762 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 278/560] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:27:25.269280 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:25.270242 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:25.277527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.278129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.279075 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.279525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.442704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:25.455194 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7410b8ec-b219-4e7b-be72-4d77c8113578 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.526270 Jun 20 12:27:25.465021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 283/561] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:24 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:25.472136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:25.472900 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:25.479381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.480076 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.481720 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.482547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.507963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:25.519004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7842bcc5-466a-4b9b-9380-31fe3012c1a5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.254015 Jun 20 12:27:25.519865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 279/562] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:25 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:25.525790 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:25.526431 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:25.532607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.533878 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.534886 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.535480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.555968 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:25.563589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-866e0da6-2da5-4f49-9380-7cd6c8ef8b5a tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 200 len: 1471 microversion: 2.1 time: 0.097327 Jun 20 12:27:25.564203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 284/563] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:25 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 1471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:25.570153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-ddbd548d-1bd0-43e1-923e-39a83e4d8284 req-c4867f8a-6750-4b4b-985f-afccfb37b523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffe781f-e20e-44ed-b2ee-98a480b22e16", "name": "network-vif-deleted", "tag": "a152becc-7b1c-458b-8a76-0109904c9d04"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:25.578984 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ddbd548d-1bd0-43e1-923e-39a83e4d8284 req-c4867f8a-6750-4b4b-985f-afccfb37b523 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:25.579417 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ddbd548d-1bd0-43e1-923e-39a83e4d8284 req-c4867f8a-6750-4b4b-985f-afccfb37b523 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:25.591890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-ddbd548d-1bd0-43e1-923e-39a83e4d8284 req-c4867f8a-6750-4b4b-985f-afccfb37b523 service nova] Creating event network-vif-deleted:a152becc-7b1c-458b-8a76-0109904c9d04 for instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 on hv-cinder-83697 Jun 20 12:27:25.597999 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-ddbd548d-1bd0-43e1-923e-39a83e4d8284 req-c4867f8a-6750-4b4b-985f-afccfb37b523 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031865 Jun 20 12:27:25.598798 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 285/564] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:25.727830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:25.737941 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f2f2bdb6-3801-441f-b6bd-30d0fad7c4e0 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.216848 Jun 20 12:27:25.738516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 280/565] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:25 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:26.473443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:26.474875 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:26.481624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.482092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.482865 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.483319 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.536980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:26.537598 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:26.545972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.546636 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.547561 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.548154 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.624892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:26.632589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3cbc9fe3-f228-41ea-8c88-3dee4bdd2514 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.164489 Jun 20 12:27:26.633358 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 286/566] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:26 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:26.644574 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:26.645347 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 1ffe781f-e20e-44ed-b2ee-98a480b22e16] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:26.652401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.652957 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.653870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.654509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.669959 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] HTTP exception thrown: Instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 could not be found. Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Request method failure captured: Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 HTTP/1.1 Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGdgxsJ4ZiUkjLX1dHdyl4qw4eGI2wK4ckn6pLOg8UWrH6_rDduiKQB62L4C7CpRX3AcBWJfmuq4B160NCTmdp6EZcUWY0Rr_z_rXm5IHgsYrfqV7Xrg7L_S_cYzCNZMt8EQ4ywZzArrgnox4wwJ-IhyL7BiAFWbgjgim_hwRFseSOM Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: d9b0e8111c084f769bbc267365364900 Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesSnapshotTestJSON-148872802 Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:27:26.671608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d9b0e8111c084f769bbc267365364900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d9b0e8111c084f769bbc267365364900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d9b0e8111c084f769bbc267365364900"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d9b0e8111c084f769bbc267365364900"}]}] Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesSnapshotTestJSON-148872802 Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: d9b0e8111c084f769bbc267365364900 Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-148872802 Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesSnapshotTestJSON-148872802-project Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 7c5ef23fbdb145bfa485859ff4c43b4c Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesSnapshotTestJSON-148872802-project Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 could not be found. Jun 20 12:27:26.673190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '1ffe781f-e20e-44ed-b2ee-98a480b22e16'} Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 could not be found. Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:26.682026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 could not be found. Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 could not be found. Jun 20 12:27:26.683297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:26.684390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Returning 404 to user: Instance 1ffe781f-e20e-44ed-b2ee-98a480b22e16 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:26.684390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a3397238-4fa1-4e48-b2af-efb97e13cd24 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16" status: 404 len: 111 microversion: 2.1 time: 0.038680 Jun 20 12:27:26.684390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 287/567] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:26 2022] GET /compute/v2.1/servers/1ffe781f-e20e-44ed-b2ee-98a480b22e16 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:26.694198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:26.704785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-58c1d4ab-b4b4-465c-a835-5f17bd305ad3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.172630 Jun 20 12:27:26.707070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 281/568] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:26 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:26.755309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:26.756049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:26.762691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.763376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.764380 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.764828 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.788914 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-6640ef10-00f3-4984-a0a4-d565cf728083 req-bf5c5d55-c286-4496-876e-10e2fc8583cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46973eb-c676-4cd1-9b9b-5e4a2943c518", "name": "network-vif-plugged", "status": "completed", "tag": "ead77c80-977e-4a4c-904f-7d880c8e28a3"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:26.797473 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-6640ef10-00f3-4984-a0a4-d565cf728083 req-bf5c5d55-c286-4496-876e-10e2fc8583cd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:26.797982 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-6640ef10-00f3-4984-a0a4-d565cf728083 req-bf5c5d55-c286-4496-876e-10e2fc8583cd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:26.809753 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-6640ef10-00f3-4984-a0a4-d565cf728083 req-bf5c5d55-c286-4496-876e-10e2fc8583cd service nova] Creating event network-vif-plugged:ead77c80-977e-4a4c-904f-7d880c8e28a3 for instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 on hv-cinder-83697 Jun 20 12:27:26.814739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-6640ef10-00f3-4984-a0a4-d565cf728083 req-bf5c5d55-c286-4496-876e-10e2fc8583cd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Jun 20 12:27:26.815359 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 282/569] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:27:26.907205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:26.915908 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d5ee9a3e-c686-41d7-9d61-090ad6fec440 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.164670 Jun 20 12:27:26.916761 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 288/570] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:26 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:27.650567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:27.651228 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:27.657522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.658975 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.659767 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.660206 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.722545 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:27.723350 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:27.730400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.730921 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.731763 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.732292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.793466 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:27.800855 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-79755344-768d-4720-8b8a-604e7f802000 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.155104 Jun 20 12:27:27.801598 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 283/571] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:27 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:27.862037 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:27.869591 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9c66e650-3b6b-4305-a0dc-84e3ff9b25ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.151704 Jun 20 12:27:27.870190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 289/572] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:27 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:27.933619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:27.934270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:27.940909 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.941351 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:27.942172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:27.942607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:28.072541 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:28.080809 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2cddfe07-94c5-40d4-9272-fa5805e0664b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.150800 Jun 20 12:27:28.081848 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 284/573] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:27 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:28.818100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:28.818709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:28.825224 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:28.825666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:28.826462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:28.826896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:28.886422 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:28.887039 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:28.894375 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:28.894829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:28.895606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:28.896052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:28.960445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:28.967801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b02806bb-b9c7-4349-bed6-d5ce21e08105 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.154112 Jun 20 12:27:28.968361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 290/574] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:28 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:29.027158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:29.034882 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-770c12cc-4c5e-4096-b593-ea260984707b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.152340 Jun 20 12:27:29.035445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 285/575] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:28 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:29.097924 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:29.098531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:29.104745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:29.105198 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:29.106017 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:29.106459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:29.234125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:29.242517 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-28787e70-b5f2-471b-9894-a73eb4c82f92 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.148887 Jun 20 12:27:29.243077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 291/576] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:29 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:29.984602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:29.985223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:29.992578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:29.993033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:29.993827 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:29.994272 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.051719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:30.052441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:30.056138 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:30.059706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.060150 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.060928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.061354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.129699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:30.137240 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ccf62f9e-281d-46e6-b869-c5b91f491d16 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.156547 Jun 20 12:27:30.137833 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 286/577] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:29 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:30.203281 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:30.211258 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bd23a159-6b55-4f31-a52b-29cd3804f0b2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.164001 Jun 20 12:27:30.211818 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 292/578] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:30 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:30.259111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:30.259781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:30.265698 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.271889 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.271889 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.271889 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.397997 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:30.405327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9bc38c2e-a12d-4706-bdbc-cb9e5994148f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.150126 Jun 20 12:27:30.405914 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 287/579] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:30 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:30.566565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-fb2f2621-08d5-45ab-8820-484691e7acef req-8a496866-2af5-48db-bce8-556213183381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c50771-1643-4ddb-9375-6e52b0789270", "name": "network-vif-plugged", "status": "completed", "tag": "aeb492a1-b6de-465b-b91f-a1ad04692797"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:30.574767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fb2f2621-08d5-45ab-8820-484691e7acef req-8a496866-2af5-48db-bce8-556213183381 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:30.575203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fb2f2621-08d5-45ab-8820-484691e7acef req-8a496866-2af5-48db-bce8-556213183381 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:30.586716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-fb2f2621-08d5-45ab-8820-484691e7acef req-8a496866-2af5-48db-bce8-556213183381 service nova] Creating event network-vif-plugged:aeb492a1-b6de-465b-b91f-a1ad04692797 for instance 99c50771-1643-4ddb-9375-6e52b0789270 on hv-cinder-83697 Jun 20 12:27:30.591422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-fb2f2621-08d5-45ab-8820-484691e7acef req-8a496866-2af5-48db-bce8-556213183381 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029290 Jun 20 12:27:30.591981 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 293/580] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:31.154523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:31.155134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:31.162999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.163445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.164208 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.164637 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.232708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:31.234832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:31.244319 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.245024 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.246344 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.247047 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.313194 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:31.321239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e3a66f00-a66a-4bd4-8eac-c8a763b48982 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.170495 Jun 20 12:27:31.322158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 288/581] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:31 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:31.396796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:31.404371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-46480164-3162-4fcf-be2e-bc30e815d2be tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.178784 Jun 20 12:27:31.404927 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 294/582] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:31 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:31.423067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:31.423688 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:31.429752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.434259 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.434259 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:31.434259 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:31.570950 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:31.578500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-bac2db99-2562-490f-868d-a18f7d92708a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1367 microversion: 2.1 time: 0.159286 Jun 20 12:27:31.579010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 289/583] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:31 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:32.339405 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:32.340038 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:32.347636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.348082 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.348870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.349303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.422333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:32.422883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:32.430256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.430703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.431471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.431902 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.453027 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:32.481960 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:32.489522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1a9b7d82-e87e-4212-9c3f-db451fb3f67b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.154020 Jun 20 12:27:32.491570 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 295/584] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:32 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:32.570802 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:32.578313 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-bb12e545-219b-4637-8677-b411be16b459 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.160102 Jun 20 12:27:32.580726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 290/585] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:32 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:32.595603 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:32.596230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:32.602937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.603394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.604629 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.605182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.681959 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:32.683686 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:32.693538 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.694232 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.695089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.695452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.720849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lazy-loading 'flavor' on Instance uuid f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:27:32.761462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:32.772267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7f5cfd1c-c189-4e95-9cdd-0e4e27c655b2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1556 microversion: 2.1 time: 0.180459 Jun 20 12:27:32.773072 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 296/586] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:32 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:32.789814 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8bef5bde-96fd-4aec-b77b-579ea18c3a6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:32.790318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8bef5bde-96fd-4aec-b77b-579ea18c3a6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:32.796421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bef5bde-96fd-4aec-b77b-579ea18c3a6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.796946 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bef5bde-96fd-4aec-b77b-579ea18c3a6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.797756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bef5bde-96fd-4aec-b77b-579ea18c3a6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:32.799886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8bef5bde-96fd-4aec-b77b-579ea18c3a6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:32.877463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8bef5bde-96fd-4aec-b77b-579ea18c3a6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091119 Jun 20 12:27:32.878802 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 297/587] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:27:32 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:27:33.143054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-098bb4ca-95c6-49ad-8e55-af39885a2db9 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/action" status: 200 len: 32 microversion: 2.1 time: 0.465792 Jun 20 12:27:33.145639 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 291/588] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:27:32 2022] POST /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/action => generated 32 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:27:33.153347 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.153932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.161123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.161575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.162381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.162918 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.186432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b5d0f445-fb58-4a87-a276-4065279dadd3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.187487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b5d0f445-fb58-4a87-a276-4065279dadd3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.194815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5d0f445-fb58-4a87-a276-4065279dadd3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.195264 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5d0f445-fb58-4a87-a276-4065279dadd3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.196050 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5d0f445-fb58-4a87-a276-4065279dadd3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.196690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5d0f445-fb58-4a87-a276-4065279dadd3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.230305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b5d0f445-fb58-4a87-a276-4065279dadd3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050766 Jun 20 12:27:33.230872 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 292/589] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:27:33 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 12:27:33.301275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.301785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.308429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.309129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.310227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.310824 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.317109 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:33.325668 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-39a1f505-f211-4239-81d8-e06f9a131b6a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.176174 Jun 20 12:27:33.326282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 298/590] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:33 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:33.338523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:27:33.506397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.507032 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.514226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.514965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.515881 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.516374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.614319 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9fc59ff5-8cef-47ba-8021-cce6427ab89f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 204 len: 0 microversion: 2.1 time: 0.317327 Jun 20 12:27:33.615218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 293/591] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:27:33 2022] DELETE /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:27:33.620448 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.621147 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.627636 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.628304 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.629364 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.629993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.680156 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:33.687714 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ecd68c44-4783-4350-b918-cf3e06084e3a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1357 microversion: 2.1 time: 0.185351 Jun 20 12:27:33.688276 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 299/592] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:33 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:33.693386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:33.694243 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:33.700150 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.700598 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.701438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:33.701795 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:33.722555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:33.814438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:33.823155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c51c6a43-a45d-4c02-aad9-1c3e08d8c7da tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1278 microversion: 2.1 time: 0.206727 Jun 20 12:27:33.823726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 294/593] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:33 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:33.843582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:33.851989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5b2b8a0b-f200-496e-bf34-5b0cee54496b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1672 microversion: 2.1 time: 0.162733 Jun 20 12:27:33.852558 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 300/594] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:33 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:34.210997 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-291d1cbc-fd21-448d-b8e7-41ead625b8fe req-bcbc5018-5d34-445e-84f4-9e92ae43201a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46973eb-c676-4cd1-9b9b-5e4a2943c518", "tag": "ead77c80-977e-4a4c-904f-7d880c8e28a3"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:34.219217 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-291d1cbc-fd21-448d-b8e7-41ead625b8fe req-bcbc5018-5d34-445e-84f4-9e92ae43201a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.219669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-291d1cbc-fd21-448d-b8e7-41ead625b8fe req-bcbc5018-5d34-445e-84f4-9e92ae43201a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.231127 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-291d1cbc-fd21-448d-b8e7-41ead625b8fe req-bcbc5018-5d34-445e-84f4-9e92ae43201a service nova] Creating event network-changed:ead77c80-977e-4a4c-904f-7d880c8e28a3 for instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 on hv-cinder-83697 Jun 20 12:27:34.236565 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-291d1cbc-fd21-448d-b8e7-41ead625b8fe req-bcbc5018-5d34-445e-84f4-9e92ae43201a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028667 Jun 20 12:27:34.237333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 295/595] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:34.343969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:34.344497 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:34.351445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.351895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.352676 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.353109 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.487492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:34.495532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4f56e4c7-4af3-49b5-81da-2787eca78957 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.155649 Jun 20 12:27:34.496325 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 301/596] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:34 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:34.706386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:34.707083 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:34.713382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.713854 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.715064 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.715064 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.841664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:34.842394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:34.849306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.849756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.850607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:34.851205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.851647 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.859716 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-928d73be-60a4-464c-97b6-c4df5026892f tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1547 microversion: 2.1 time: 0.158847 Jun 20 12:27:34.860296 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 296/597] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:34 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:34.869256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:34.870178 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:34.878125 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.878912 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.879893 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:34.880561 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:34.997472 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:35.005578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f2771e5a-350a-4d85-903f-7b835f5fc130 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.168961 Jun 20 12:27:35.006437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 302/598] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:34 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:35.011198 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:35.012081 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:35.019487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.020006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.020991 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.021437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.029903 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:35.039468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6febfb91-a83d-4f1e-91a4-633d680485da tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1672 microversion: 2.1 time: 0.174874 Jun 20 12:27:35.040049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 297/599] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:34 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:35.164413 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:35.172391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d80c3039-c452-4885-b67c-4d082d31a5c9 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1547 microversion: 2.1 time: 0.164713 Jun 20 12:27:35.172971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 303/600] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:35 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:35.189818 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:35.193521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:35.194322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Searching by: {'deleted': False, 'project_id': '7a033c0ad5484ff89949482c587ea5e7'} {{(pid=118091) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 12:27:35.201134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.201592 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.202423 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.202864 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.334927 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.multi_cell_list [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118091) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 12:27:35.471397 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3c63545d-3446-42a7-aa77-d2a0f1f64275 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.285606 Jun 20 12:27:35.471965 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 298/601] 10.222.0.64 () {58 vars in 1124 bytes} [Mon Jun 20 12:27:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:35.482061 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:35.482665 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:35.489501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.489983 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.490767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.491193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.513542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:35.514224 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:35.520395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.520852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.521627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:35.522100 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:35.622432 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:35.630315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-71276168-ce2d-44ea-812b-95b4352143e1 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1547 microversion: 2.1 time: 0.151997 Jun 20 12:27:35.630889 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 304/602] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:35 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:35.653494 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:35.662309 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2ac24029-3bec-496e-b029-e39b04880c32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.152577 Jun 20 12:27:35.662820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 299/603] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:35 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:36.023744 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:36.024129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:36.030398 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.030841 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.031612 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.032047 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.056354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:36.056986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:36.063354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.063799 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.064731 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.065358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.172324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:36.180122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-774bc279-a6be-4b4c-ac27-5f0ef324cf95 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.160610 Jun 20 12:27:36.180724 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 305/604] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:36 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:36.208590 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:36.216160 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d49d8dd5-2e48-49f5-9246-b200a85299a5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1672 microversion: 2.1 time: 0.163593 Jun 20 12:27:36.216673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 300/605] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:36 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:36.375301 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1126615915", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "networks": [{"uuid": "d66b3092-b630-48bc-83c0-f6e6929a752b"}]}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:36.429256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] validate_networks() for [('d66b3092-b630-48bc-83c0-f6e6929a752b', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:36.679529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:36.680137 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:36.686512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.686986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.687732 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.688175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.784623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:27:36.785053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:27:36.785520 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:27:36.785951 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:27:36.786359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:27:36.795315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.795760 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.797959 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:36.797959 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:36.815748 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Getting quotas for project d9b0e8111c084f769bbc267365364900. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:36.819728 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Getting quotas for user 7c5ef23fbdb145bfa485859ff4c43b4c and project d9b0e8111c084f769bbc267365364900. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:36.825384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:36.831065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:27:36.833321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:27:36.833795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-bf969029-e1cc-4138-8be2-a5d00a2a38f7 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.158116 Jun 20 12:27:36.834399 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 301/606] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:36 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:37.010684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6c199482-1aba-4809-8e48-3194837137d9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639459 Jun 20 12:27:37.011356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 306/607] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:27:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:27:37.021454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4f47833b-ef39-472e-aea7-95104cf72a41 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:37.022053 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4f47833b-ef39-472e-aea7-95104cf72a41 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:37.086663 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4f47833b-ef39-472e-aea7-95104cf72a41 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:37.093547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4f47833b-ef39-472e-aea7-95104cf72a41 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1219 microversion: 2.1 time: 0.075902 Jun 20 12:27:37.094198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 302/608] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:37 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:37.197341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:37.197996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:37.204762 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.205256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:37.206075 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.206622 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:37.232935 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:37.233547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:37.241069 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.241517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:37.242677 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.243367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:37.349119 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:37.357596 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ac885ee2-808f-4cde-aedc-79fc56f8c5a0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.164351 Jun 20 12:27:37.358316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 307/609] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:37 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:37.387145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:37.395655 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9c4980e6-a8a8-4a0d-b9f2-0cf7974435fa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1672 microversion: 2.1 time: 0.166772 Jun 20 12:27:37.396212 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 303/610] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:37 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:37.614176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-66826c23-c3df-4811-b901-c7fee3351341 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c30f11fa-d24b-41f7-bf2f-dc321e0ae295"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:37.615316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-66826c23-c3df-4811-b901-c7fee3351341 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:37.621592 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66826c23-c3df-4811-b901-c7fee3351341 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.622071 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66826c23-c3df-4811-b901-c7fee3351341 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:37.622828 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66826c23-c3df-4811-b901-c7fee3351341 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.623256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66826c23-c3df-4811-b901-c7fee3351341 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:37.851766 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:37.852393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:37.858525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.858979 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:37.859754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:37.860195 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.036071 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:38.039858 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:38.045852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6554ebdc-33f7-4f00-be2e-e5cec7181afe tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.197737 Jun 20 12:27:38.046535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 304/611] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:37 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:38.112398 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:38.113054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:38.119893 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.120382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.121124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.121562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.184639 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:38.192726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-abf0f399-02d0-4654-86d4-811c920c6205 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1223 microversion: 2.1 time: 0.085403 Jun 20 12:27:38.193355 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 305/612] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:38 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:38.374907 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:38.375521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:38.382900 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.383402 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.384175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.384615 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.625766 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:38.634954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4eb8b381-c3de-4589-9cd2-081bf0cdc1dd tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.263840 Jun 20 12:27:38.635825 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 306/613] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:38 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:38.640482 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:38.641080 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:38.654231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.658393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.658393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:38.658393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:38.844864 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:38.852927 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-04587d89-6971-42bf-b6fd-7b92bf4c94ec tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1672 microversion: 2.1 time: 0.215943 Jun 20 12:27:38.853742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 307/614] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:38 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:38.910660 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-66826c23-c3df-4811-b901-c7fee3351341 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.300478 Jun 20 12:27:38.911567 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 308/615] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:27:37 2022] POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments => generated 194 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:39.063896 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:39.065435 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:39.072311 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.073044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.074145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.074726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.210506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:39.211268 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:39.217648 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:39.218305 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.218927 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.219712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.220153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.229771 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-90431fb4-3514-461c-acfd-e78855226c97 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.170146 Jun 20 12:27:39.230947 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 308/616] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:39 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:39.368107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:39.390892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c8c560b9-9a2e-4195-80f3-9b71334a7ea0 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1279 microversion: 2.1 time: 0.176611 Jun 20 12:27:39.391526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 309/617] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:39 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:39.652723 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:39.653340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:39.660004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.660457 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.661231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.661663 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.789974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-aa37f28d-131b-431f-8de4-f68abd3b8db8 req-63e6bcc4-b6a0-4368-8edd-291613b4b1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a331a3-6307-47a9-b9b8-cd94a0217c11", "name": "network-vif-deleted", "tag": "93788802-61f0-473d-9861-00643d29473b"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:39.813895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-aa37f28d-131b-431f-8de4-f68abd3b8db8 req-63e6bcc4-b6a0-4368-8edd-291613b4b1a6 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.815223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-aa37f28d-131b-431f-8de4-f68abd3b8db8 req-63e6bcc4-b6a0-4368-8edd-291613b4b1a6 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.831178 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-aa37f28d-131b-431f-8de4-f68abd3b8db8 req-63e6bcc4-b6a0-4368-8edd-291613b4b1a6 service nova] Creating event network-vif-deleted:93788802-61f0-473d-9861-00643d29473b for instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 on hv-cinder-83697 Jun 20 12:27:39.845795 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-aa37f28d-131b-431f-8de4-f68abd3b8db8 req-63e6bcc4-b6a0-4368-8edd-291613b4b1a6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059984 Jun 20 12:27:39.853336 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 310/618] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:39.854116 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:39.871436 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b15926fa-ab1b-49bb-b4b9-3619541886c2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.222468 Jun 20 12:27:39.872588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:39.873291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:39.874931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 309/619] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:39 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:39.891991 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.893376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.893725 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:39.900155 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:39.995035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:40.008340 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2b4501e4-c0dc-46d4-9379-d85fc6f1b217 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 200 len: 1604 microversion: 2.1 time: 0.139741 Jun 20 12:27:40.009445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 311/620] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:39 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:40.248935 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:40.249547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:40.257612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:40.258357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:40.259131 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:40.259617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:40.410238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:40.411437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:40.413681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:40.417525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:40.418016 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:40.418929 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:40.419703 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:40.422411 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ebef4f4b-9a39-492f-9f0a-8d5a3308bc9b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.178672 Jun 20 12:27:40.423033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 310/621] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:40 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:40.636424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:40.653467 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bd5c5579-e30c-4cca-b3d4-5613f132d292 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.248670 Jun 20 12:27:40.654203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 312/622] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:40 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:40.891839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:40.893037 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:40.903472 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:40.903472 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:40.903472 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:40.903472 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.026234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:41.026845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:41.038534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.038997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.040276 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.040867 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.044527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:41.052683 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ccd3b1e8-d5b9-450c-b6c5-b6a9043c1d70 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.164712 Jun 20 12:27:41.053266 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 311/623] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:40 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:41.057729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] HTTP exception thrown: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Request method failure captured: Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 HTTP/1.1 Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGam4vxCtgYiLajilu2IiHrrW6mcCPHnWc9lSua9nWV3V0Y9_fue2YCD562NAfDkiNdHy20HY99tEPU6vzYOeg7htwvm0-Q4Qes24Rcl5M-LJgJR-aj4W-BOP5y9TR9o2dM_knlW4I2n9RiPdWtO2ePJpJrkXrhVA50PQDoNAVwpT1c Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:27:41.059604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}] Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 41eb98b3a8434e7e9734eb747047a87d Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:27:41.060911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'd4a331a3-6307-47a9-b9b8-cd94a0217c11'} Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:27:41.061634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:27:41.063144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:27:41.065063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Returning 404 to user: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:27:41.065063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f1608f33-56fc-4378-956e-79cafd2e0d5f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 404 len: 111 microversion: 2.1 time: 0.038925 Jun 20 12:27:41.070539 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 313/624] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:41 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:27:41.078072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-38010e54-be81-4a22-b5f1-a5700d13129d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '.version_select at 0x7fe2900f4d30>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:41.099340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:41.198568 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-38010e54-be81-4a22-b5f1-a5700d13129d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891217855" status: 202 len: 0 microversion: 2.1 time: 0.124940 Jun 20 12:27:41.199156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 312/625] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jun 20 12:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891217855 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:27:41.440552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:41.441085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:41.447185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.447632 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.448396 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.448833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.671693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:41.672247 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:41.680211 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.680641 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.681852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.682292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.822810 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:41.830536 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9bcc2ead-290d-4faf-9e21-89fbb4762c3d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.162941 Jun 20 12:27:41.831196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 313/626] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:41 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:41.870583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-f6a60cb8-8f46-4e37-bb62-187db7afda15 req-9de019fe-4227-4a02-bacb-2407f1180acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8969b640-7480-4461-b210-d2c9ee794f9c", "tag": "e51c046d-a57a-492a-932e-fab7af9242b1"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:41.879395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f6a60cb8-8f46-4e37-bb62-187db7afda15 req-9de019fe-4227-4a02-bacb-2407f1180acd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:41.879821 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f6a60cb8-8f46-4e37-bb62-187db7afda15 req-9de019fe-4227-4a02-bacb-2407f1180acd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:41.890742 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-f6a60cb8-8f46-4e37-bb62-187db7afda15 req-9de019fe-4227-4a02-bacb-2407f1180acd service nova] Creating event network-changed:e51c046d-a57a-492a-932e-fab7af9242b1 for instance 8969b640-7480-4461-b210-d2c9ee794f9c on hv-cinder-83697 Jun 20 12:27:41.895702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-f6a60cb8-8f46-4e37-bb62-187db7afda15 req-9de019fe-4227-4a02-bacb-2407f1180acd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028744 Jun 20 12:27:41.896323 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 314/627] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:27:42.071791 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:42.072314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:42.073700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:42.080960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:42.081411 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:42.082440 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:42.083371 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:42.086532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-55032f64-499c-4b7d-8329-b9ed8be9c951 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.650208 Jun 20 12:27:42.087105 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 314/628] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:41 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:42.232749 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:42.241118 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cbef8a7a-6db2-45d5-9154-4494a3272f4e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.173890 Jun 20 12:27:42.242178 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 315/629] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:42 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:42.604361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e5db12f1-fbb8-48cc-aefb-acf323c00dc3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'create', calling method: .version_select at 0x7fe29092ec10>, body: {"keypair": {"name": "tempest-keypair-693568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBz2ccfXAPzrIvRSezuaVvXWMSnVFkWyKJ37eFPCB1FdPdvJ76fMXfVhr2zVufJ6rVLTB1HWsBmDyQxeZDaEsM8Yh4UxRprvSDrhPmJd99OTMc9Q9yhLROxW+a00lPqEw=="}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:42.618296 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-e5db12f1-fbb8-48cc-aefb-acf323c00dc3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'key_pairs'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:42.622059 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-e5db12f1-fbb8-48cc-aefb-acf323c00dc3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for user 41eb98b3a8434e7e9734eb747047a87d and project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'key_pairs'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:42.746973 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e5db12f1-fbb8-48cc-aefb-acf323c00dc3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.146488 Jun 20 12:27:42.747493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 315/630] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:27:42 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:42.848149 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:42.848767 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:42.855190 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:42.855639 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:42.856406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:42.856839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:42.994147 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:43.001542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1b8d0906-fd53-4532-8692-d51c475f3c6b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.158002 Jun 20 12:27:43.002773 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 316/631] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:42 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:43.104544 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:43.105829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:43.114249 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:43.114249 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:43.114249 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:43.114249 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:43.258935 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:43.259498 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:43.265489 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:43.265988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:43.266767 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:43.267210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:43.293699 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:43.300356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-59b89a24-69e7-4b05-82eb-9accdd38363d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.199763 Jun 20 12:27:43.300924 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 316/632] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:43 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:43.401327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:43.408958 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-13a384fd-0c09-42a2-9678-fdc9e1f45f19 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.153997 Jun 20 12:27:43.409775 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 317/633] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:43 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:44.019633 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:44.020346 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:44.026552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.027126 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:44.027976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.028484 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:44.216223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:44.225311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c32d3d57-d960-4257-8738-4c33ab92b485 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.209996 Jun 20 12:27:44.225939 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 317/634] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:44 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:44.317302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:44.317979 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:44.327734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.327734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:44.327734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.327734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:44.425505 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:44.426160 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:44.432393 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.432850 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:44.433629 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:44.434111 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:44.488031 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:44.497567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f2b9cdc9-ac92-4620-b6d3-daf3a2bdb580 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.184349 Jun 20 12:27:44.498194 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 318/635] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:44 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:44.661893 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:44.665424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:44.670151 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-237c639e-6a00-4f2c-88f4-ebfce89a6ec2 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.248536 Jun 20 12:27:44.670728 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 318/636] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:44 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:45.243695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:45.244479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:45.246769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:45.251883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:45.252654 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:45.253652 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:45.254193 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:45.407691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:45.416137 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d6b10534-a914-44e9-8118-25329d769903 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.176508 Jun 20 12:27:45.416740 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 319/637] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:45 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:45.517091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:45.519342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:45.526519 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:45.526972 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:45.527750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:45.528187 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:45.678747 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:45.679457 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1233058418", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cb023b5-9bac-4dc4-978f-aa570457c65c"}], "security_groups": [{"name": "tempest-securitygroup--771751087"}], "key_name": "tempest-keypair-693568", "user_data": "}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:45.686959 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-886109ea-2df7-4b5e-b8a5-cf6ab2c5e896 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.174252 Jun 20 12:27:45.694033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 319/638] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:45 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:45.694033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:45.694033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:45.699807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:45.700176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:45.700976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:45.701497 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:45.785830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] validate_networks() for [('3cb023b5-9bac-4dc4-978f-aa570457c65c', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:27:45.839896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:45.848167 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1b143784-2fcd-4a9b-afe0-a754929a29fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.159688 Jun 20 12:27:45.848727 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 320/639] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:45 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:46.156901 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:27:46.157362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:27:46.157915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:27:46.158533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:27:46.159454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:27:46.168945 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.169416 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.170262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.170707 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.187896 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:27:46.193343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Getting quotas for user 41eb98b3a8434e7e9734eb747047a87d and project 3c7566543a6145b7b1a01612aff1c02a. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:27:46.204470 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:27:46.207441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:27:46.352094 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-99d2b164-8571-48e8-8077-d328a3d581c1 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.678121 Jun 20 12:27:46.353070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 320/640] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:27:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 12:27:46.363776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b93457a7-54c3-455a-9e83-cd901b61cbdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:46.364728 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b93457a7-54c3-455a-9e83-cd901b61cbdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:46.432485 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:46.433103 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:46.436298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b93457a7-54c3-455a-9e83-cd901b61cbdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:46.445315 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.445766 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.446578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.447014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.462361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b93457a7-54c3-455a-9e83-cd901b61cbdd tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1234 microversion: 2.1 time: 0.095371 Jun 20 12:27:46.462361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 321/641] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:46 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1234 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:46.600969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:46.608555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4659eaac-c914-471b-8978-e67b844cd2e9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.179834 Jun 20 12:27:46.609127 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 321/642] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:46 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:46.705634 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:46.706796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:46.713177 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.713617 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.714412 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.714843 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.808537 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:46.829005 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-5e804101-8028-45c6-b37f-8e5fd13cfcde req-ed1369c8-be6d-4b4e-b82b-bef1096ad47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8969b640-7480-4461-b210-d2c9ee794f9c", "name": "network-vif-plugged", "status": "completed", "tag": "e51c046d-a57a-492a-932e-fab7af9242b1"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:46.839040 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-5e804101-8028-45c6-b37f-8e5fd13cfcde req-ed1369c8-be6d-4b4e-b82b-bef1096ad47f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.839483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-5e804101-8028-45c6-b37f-8e5fd13cfcde req-ed1369c8-be6d-4b4e-b82b-bef1096ad47f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.851906 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-5e804101-8028-45c6-b37f-8e5fd13cfcde req-ed1369c8-be6d-4b4e-b82b-bef1096ad47f service nova] Creating event network-vif-plugged:e51c046d-a57a-492a-932e-fab7af9242b1 for instance 8969b640-7480-4461-b210-d2c9ee794f9c on hv-cinder-83697 Jun 20 12:27:46.857211 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-5e804101-8028-45c6-b37f-8e5fd13cfcde req-ed1369c8-be6d-4b4e-b82b-bef1096ad47f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031830 Jun 20 12:27:46.858214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 322/643] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:46.868553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:46.878851 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-475c9f0c-355b-4173-b1dd-f222da312669 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.178045 Jun 20 12:27:46.879467 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 322/644] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:46 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:46.879737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:46.880547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:46.888288 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.889168 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:46.891559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:46.894372 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.041887 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:47.051606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cad5f14e-0772-47fb-b8c8-a56deb4bff9f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.184251 Jun 20 12:27:47.056062 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 323/645] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:46 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:47.473645 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:47.474306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:47.480359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.480803 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.481561 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.482338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.546218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:47.553577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a97c6b20-8477-402b-912f-002d63bca4b7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1238 microversion: 2.1 time: 0.084569 Jun 20 12:27:47.554251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 323/646] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:47 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:47.624373 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:47.625207 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:47.632368 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.632829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.633069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:47.633637 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.633755 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:47.634107 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.639679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.640127 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.640924 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.641951 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.652923 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:47.771441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:47.776735 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:47.779652 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-38846bf4-e029-4155-a925-2ac42fc69e2d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.159056 Jun 20 12:27:47.780421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 324/647] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:47 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:47.785293 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-18c2199f-ff61-4dee-98ab-5f7f5f28ddb6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1593 microversion: 2.1 time: 0.155875 Jun 20 12:27:47.788262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 324/648] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:47 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:47.896336 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:47.896970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:47.903609 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.904066 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:47.904845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:47.905282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.056987 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:48.063731 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a9233044-c7e2-4850-96d1-c0f2e317dfb2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.171423 Jun 20 12:27:48.064896 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 325/649] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:47 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:48.068606 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:48.069461 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:48.076360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.080005 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.080005 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.080005 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.220069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:48.228888 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9aa565c6-cab3-45db-82bc-5ff761ef8782 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.164574 Jun 20 12:27:48.229455 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 325/650] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:48 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:48.571863 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:48.572495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:48.581756 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.584964 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.584964 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.584964 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.796424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:48.797487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:48.803871 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.804312 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.805110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.805538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.821289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:48.832077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ff773fe2-b970-46e1-bf14-bd3cf5ffab5c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1286 microversion: 2.1 time: 0.264768 Jun 20 12:27:48.838492 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 326/651] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:48 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1286 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:48.872369 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-10656346-ec75-4852-8ca4-676e02d91a9e req-5159710a-8ce9-43ae-8056-4dddd7c3b1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36070a3e-9c08-45f3-a574-2412cabfe0ed", "name": "network-vif-plugged", "status": "completed", "tag": "53e7a966-d8ba-4ea1-befa-d940c1785d69"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:48.881100 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-10656346-ec75-4852-8ca4-676e02d91a9e req-5159710a-8ce9-43ae-8056-4dddd7c3b1cf service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:48.890354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-10656346-ec75-4852-8ca4-676e02d91a9e req-5159710a-8ce9-43ae-8056-4dddd7c3b1cf service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:48.894891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-10656346-ec75-4852-8ca4-676e02d91a9e req-5159710a-8ce9-43ae-8056-4dddd7c3b1cf service nova] Creating event network-vif-plugged:53e7a966-d8ba-4ea1-befa-d940c1785d69 for instance 36070a3e-9c08-45f3-a574-2412cabfe0ed on hv-cinder-83697 Jun 20 12:27:48.900199 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-10656346-ec75-4852-8ca4-676e02d91a9e req-5159710a-8ce9-43ae-8056-4dddd7c3b1cf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031522 Jun 20 12:27:48.901010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 327/652] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:48.964066 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:48.974723 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-49ed9a1f-4d38-4926-80d9-d3215f487755 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1319 microversion: 2.1 time: 0.182098 Jun 20 12:27:48.975299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 326/653] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:48 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:49.082642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:49.083349 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:49.089866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:49.090342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:49.091045 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:49.091488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:49.249697 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:49.250952 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:49.259903 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:49.260436 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:49.261462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:49.261990 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:49.326815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:49.337105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d93ca7bc-1b78-4e88-9fc7-ae8d877fcd90 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.259491 Jun 20 12:27:49.337701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 328/654] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:49 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:49.506312 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:49.518555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-238d4a67-21d8-43e3-846d-869252d95553 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.275346 Jun 20 12:27:49.534045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 327/655] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:49 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:49.851059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:49.851713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:49.857930 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:49.858385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:49.859166 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:49.859606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:49.943854 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:49.950494 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9976c93b-49e9-4bc0-a5f0-a8f929387d60 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1292 microversion: 2.1 time: 0.104527 Jun 20 12:27:49.951082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 329/656] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:49 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:50.003087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:50.004320 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:50.011533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.012125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.013010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.013456 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.286481 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:50.294227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a76c1cfd-87b9-4bb2-85fd-28d7e95083c9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1507 microversion: 2.1 time: 0.296477 Jun 20 12:27:50.294946 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 328/657] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:49 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:50.317271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-689ae020-ee53-4ddd-9d0f-04449e46a04d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2881def7-4e03-44f7-a306-2d7ee2664546", "device": "/dev/sdb"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:50.318634 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-689ae020-ee53-4ddd-9d0f-04449e46a04d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:50.325317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-689ae020-ee53-4ddd-9d0f-04449e46a04d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.325768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-689ae020-ee53-4ddd-9d0f-04449e46a04d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.326719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-689ae020-ee53-4ddd-9d0f-04449e46a04d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.327482 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-689ae020-ee53-4ddd-9d0f-04449e46a04d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.354873 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:50.355792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:50.357751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:50.363330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.363717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.364498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.365127 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.635456 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:50.645461 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8cca9538-cc1b-4288-b486-e737c848f09b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.294382 Jun 20 12:27:50.646090 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 329/658] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:50 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:50.660505 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-b670a2dd-bde1-4da8-983a-90e273388755 req-3d35f5fe-1897-43a9-8c3d-9e04890e2fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50771-1643-4ddb-9375-6e52b0789270", "tag": "aeb492a1-b6de-465b-b91f-a1ad04692797"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:50.669409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b670a2dd-bde1-4da8-983a-90e273388755 req-3d35f5fe-1897-43a9-8c3d-9e04890e2fae service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.669928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b670a2dd-bde1-4da8-983a-90e273388755 req-3d35f5fe-1897-43a9-8c3d-9e04890e2fae service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.688702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-b670a2dd-bde1-4da8-983a-90e273388755 req-3d35f5fe-1897-43a9-8c3d-9e04890e2fae service nova] Creating event network-changed:aeb492a1-b6de-465b-b91f-a1ad04692797 for instance 99c50771-1643-4ddb-9375-6e52b0789270 on hv-cinder-83697 Jun 20 12:27:50.694998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-b670a2dd-bde1-4da8-983a-90e273388755 req-3d35f5fe-1897-43a9-8c3d-9e04890e2fae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039606 Jun 20 12:27:50.699353 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 330/659] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:50.705638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:50.706941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:50.713506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.714232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:50.715168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:50.715759 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:51.261964 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:51.270371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-de85ac42-6cc0-4b48-b5e8-1238bf54b116 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1266 microversion: 2.1 time: 0.569390 Jun 20 12:27:51.273716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 331/660] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:50 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1266 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:51.281848 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:51.288583 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:51.312750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:51.312750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:51.312750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:51.312750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:51.563652 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:51.566325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-689ae020-ee53-4ddd-9d0f-04449e46a04d tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "POST /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254373 Jun 20 12:27:51.569702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 330/661] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:27:50 2022] POST /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c/os-volume_attachments => generated 194 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:51.572255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7b5665c7-620d-4e0e-b6f6-40396fdb2d5a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.296281 Jun 20 12:27:51.573674 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 332/662] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:51 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:51.664663 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:51.665920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:51.671861 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:51.672609 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:51.674242 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:51.674915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:51.863182 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:51.874065 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6b744d4a-cc9a-4f00-a752-7415c835d22e tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.214107 Jun 20 12:27:51.875262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 331/663] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:51 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:52.290720 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:52.291331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:52.297854 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.298304 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.299075 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.299506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.495963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:52.512793 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-82207f2d-813f-487a-a524-577bafe6adaf req-de4ca6de-f4a2-4933-865b-103d01fbd852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a19367-11da-40fa-b0e3-26d50b960479", "tag": "ea11fe30-3cec-4a76-bdd2-db108d460048"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:52.524174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2e454ea6-4cda-4319-9c97-0140092cbd9d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1453 microversion: 2.1 time: 0.236991 Jun 20 12:27:52.524372 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 333/664] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:52 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1453 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:52.530705 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-82207f2d-813f-487a-a524-577bafe6adaf req-de4ca6de-f4a2-4933-865b-103d01fbd852 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.531147 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-82207f2d-813f-487a-a524-577bafe6adaf req-de4ca6de-f4a2-4933-865b-103d01fbd852 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.542463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:52.543360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:52.545145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-82207f2d-813f-487a-a524-577bafe6adaf req-de4ca6de-f4a2-4933-865b-103d01fbd852 service nova] Creating event network-changed:ea11fe30-3cec-4a76-bdd2-db108d460048 for instance 74a19367-11da-40fa-b0e3-26d50b960479 on hv-cinder-83697 Jun 20 12:27:52.550110 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-82207f2d-813f-487a-a524-577bafe6adaf req-de4ca6de-f4a2-4933-865b-103d01fbd852 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046839 Jun 20 12:27:52.550764 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 332/665] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:27:52.551269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.551988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.552844 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.553218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.590869 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:52.591643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:52.612291 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.612850 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.614236 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.614901 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.813015 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:52.816013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:52.824182 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cbb55de7-ba38-41e4-a7e1-f57b345847c5 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.237296 Jun 20 12:27:52.824549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e1b3076a-9bbf-4249-89e7-41711292f0de tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1453 microversion: 2.1 time: 0.285994 Jun 20 12:27:52.825126 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 334/666] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:52 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1453 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:52.834507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 333/667] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:52 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:52.893146 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:52.894058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:52.903120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.903120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:52.903120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:52.903120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:53.203464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:53.212018 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6624f13d-c99a-40c9-bac7-7f022ed4f0fb tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.323219 Jun 20 12:27:53.212669 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 335/668] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:52 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:53.842614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:53.844059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:53.855463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:53.855991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:53.856849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:53.857378 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:53.949334 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-534575529"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:53.950838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:53.959001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:53.959729 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:53.960765 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:53.961214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:54.055017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:54.062740 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4f28a9ef-ffd1-48dd-9123-6c3fea5122f0 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.224677 Jun 20 12:27:54.064858 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 334/669] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:53 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:54.190582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.network.security_group_api [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Adding security group 227009d6-3caa-465a-b81e-5b3466a5a9a0 to port aeb492a1-b6de-465b-b91f-a1ad04692797 Jun 20 12:27:54.228479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:54.229191 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:54.235643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:54.236023 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:54.236937 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:54.237378 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:54.368019 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:54.376160 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8fb54180-67d8-42fc-b7b4-907afd88dc93 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.151600 Jun 20 12:27:54.385996 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 335/670] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:54 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:55.079331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:55.080003 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:55.086880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:55.087322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.088088 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:55.088548 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.151295 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0aa83c1f-34ab-4f78-aa44-ff178ace1e0d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/action" status: 202 len: 0 microversion: 2.1 time: 1.206099 Jun 20 12:27:55.151941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 336/671] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:27:53 2022] POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/action => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:27:55.161077 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:55.161689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:55.173890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:55.195732 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.195732 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:55.195732 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.223611 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:55.260855 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:55.270524 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-38511a30-8d38-4ba2-933a-d88131c0fb37 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.194722 Jun 20 12:27:55.271578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 336/672] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:55 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:55.276358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-1a23a9f5-6d6d-4f09-88f7-ebd1067eade0 req-66410182-c172-4426-af80-cfe43319d32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50771-1643-4ddb-9375-6e52b0789270", "tag": "aeb492a1-b6de-465b-b91f-a1ad04692797"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:55.286122 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1a23a9f5-6d6d-4f09-88f7-ebd1067eade0 req-66410182-c172-4426-af80-cfe43319d32f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:55.286863 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1a23a9f5-6d6d-4f09-88f7-ebd1067eade0 req-66410182-c172-4426-af80-cfe43319d32f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.299527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-1a23a9f5-6d6d-4f09-88f7-ebd1067eade0 req-66410182-c172-4426-af80-cfe43319d32f service nova] Creating event network-changed:aeb492a1-b6de-465b-b91f-a1ad04692797 for instance 99c50771-1643-4ddb-9375-6e52b0789270 on hv-cinder-83697 Jun 20 12:27:55.313144 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-1a23a9f5-6d6d-4f09-88f7-ebd1067eade0 req-66410182-c172-4426-af80-cfe43319d32f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032363 Jun 20 12:27:55.313144 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 337/673] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:55.394245 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:55.394958 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:55.404691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:55.404691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.404691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:55.404691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:55.559108 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:55.559679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:55.568806 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-37ce79b1-33bd-4f62-93c0-4709149ef990 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1758 microversion: 2.1 time: 0.412581 Jun 20 12:27:55.569380 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 337/674] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:55 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1758 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:27:55.581795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-33c6373e-73d4-4729-b93b-80ac4bc2d461 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.190447 Jun 20 12:27:55.582770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 338/675] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:55 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:56.289221 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:56.289850 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:56.296341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:56.296789 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:56.297560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:56.298028 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:56.435831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:56.443621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-58422630-d844-435d-b358-45eaef8dff71 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.158599 Jun 20 12:27:56.444189 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 338/676] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:56 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:56.600069 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:56.600830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:56.608060 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:56.608818 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=8 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:56.610829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:56.611904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:56.612938 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:56.613794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:56.761548 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:56.771557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-646e9ddf-ceb0-4af4-8ca4-cf67edda1a5a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.175692 Jun 20 12:27:56.773408 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 339/677] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:56 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:57.319966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-2ca8d343-a10b-4f3b-8c0b-50f3afc2912d req-bede4c47-dc96-4c8c-8ffb-a4619a4388a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36070a3e-9c08-45f3-a574-2412cabfe0ed", "tag": "53e7a966-d8ba-4ea1-befa-d940c1785d69"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:57.323465 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=12 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:57.329341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2ca8d343-a10b-4f3b-8c0b-50f3afc2912d req-bede4c47-dc96-4c8c-8ffb-a4619a4388a1 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:57.329777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2ca8d343-a10b-4f3b-8c0b-50f3afc2912d req-bede4c47-dc96-4c8c-8ffb-a4619a4388a1 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:57.342196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-2ca8d343-a10b-4f3b-8c0b-50f3afc2912d req-bede4c47-dc96-4c8c-8ffb-a4619a4388a1 service nova] Creating event network-changed:53e7a966-d8ba-4ea1-befa-d940c1785d69 for instance 36070a3e-9c08-45f3-a574-2412cabfe0ed on hv-cinder-83697 Jun 20 12:27:57.347941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-2ca8d343-a10b-4f3b-8c0b-50f3afc2912d req-bede4c47-dc96-4c8c-8ffb-a4619a4388a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031736 Jun 20 12:27:57.348631 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 339/678] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:57.460506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:57.461109 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:57.467235 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:57.467685 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:57.468461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:57.468897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:57.609162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:57.617652 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-169c8618-7b24-48d2-a1e6-a27575b69a0f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.161011 Jun 20 12:27:57.618444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 340/679] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:57 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:57.792408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:57.793233 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:57.800006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:57.800448 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:57.801418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:57.802015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:57.937691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:57.946697 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b4a54e0b-79fc-402e-9b14-cfaba5471251 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.159435 Jun 20 12:27:57.947231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 340/680] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:57 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:58.636327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:58.636998 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:58.643519 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:58.643972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:58.644734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:58.645352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:58.809028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:58.812709 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:58.819545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b5f20a45-e1d0-43ee-b34b-3e3ea993323d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.187149 Jun 20 12:27:58.820674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 341/681] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:58 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:58.823400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-102b8b6f-d6c4-4f52-a108-a4fb9ac87008 req-7c7714b4-7b8a-476d-bc5d-e05cfb2e19cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a19367-11da-40fa-b0e3-26d50b960479", "name": "network-vif-plugged", "status": "completed", "tag": "ea11fe30-3cec-4a76-bdd2-db108d460048"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:27:58.834710 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-102b8b6f-d6c4-4f52-a108-a4fb9ac87008 req-7c7714b4-7b8a-476d-bc5d-e05cfb2e19cd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:58.835158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-102b8b6f-d6c4-4f52-a108-a4fb9ac87008 req-7c7714b4-7b8a-476d-bc5d-e05cfb2e19cd service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:58.847222 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-102b8b6f-d6c4-4f52-a108-a4fb9ac87008 req-7c7714b4-7b8a-476d-bc5d-e05cfb2e19cd service nova] Creating event network-vif-plugged:ea11fe30-3cec-4a76-bdd2-db108d460048 for instance 74a19367-11da-40fa-b0e3-26d50b960479 on hv-cinder-83697 Jun 20 12:27:58.852089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-102b8b6f-d6c4-4f52-a108-a4fb9ac87008 req-7c7714b4-7b8a-476d-bc5d-e05cfb2e19cd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Jun 20 12:27:58.852701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 341/682] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:27:58.964434 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:58.965132 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:58.972052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:58.972511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:58.973282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:58.973726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:59.109678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:27:59.118105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1683a663-fc60-4a56-abd0-0bffd05568e8 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1735 microversion: 2.1 time: 0.158082 Jun 20 12:27:59.118677 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 342/683] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:58 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:27:59.836473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:27:59.837161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:27:59.843728 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:59.844174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:27:59.844930 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:27:59.845359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.105638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:00.115629 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-16790cc2-e56d-4b37-a127-fb22702ab13d tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.283385 Jun 20 12:28:00.116393 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 342/684] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:27:59 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:00.135619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:00.136286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:00.143244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.143699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.144479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.144921 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.277655 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:00.285962 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-77a416a6-185d-4e3c-8dae-a1904561497f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1715 microversion: 2.1 time: 0.154239 Jun 20 12:28:00.286540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 343/685] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:00 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:00.389325 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:00.389841 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:00.396599 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.397033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.397863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.398306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.484567 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] HTTP exception thrown: Cannot 'detach_volume' instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 while it is in vm_state rescued Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Request method failure captured: Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments/b6ea35cb-2be8-4d59-9dfb-93462f7b0895 HTTP/1.1 Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasLiox8v87mMMuwvB5sZLcpwnf36uVrAHw--DgUS8DCscm1DRQBuIFjvtXKdxnBr75BzdkY482ZHjnhHiobtA8rsvW9-z5k8IPw23hqm5Wh1-h4YBXq5kxbtrCEQmRsxIjJtXX1ahdUgulZfrYKcQ53zxnssFmkP-XIfdpo9hhlD4 Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:28:00.486261 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}] Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: ec4c5293e6a148a2a16ba4c3fc57a3a3 Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:28:00.487684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Cannot 'detach_volume' instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 while it is in vm_state rescued Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'server_id': 'f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4', 'id': 'b6ea35cb-2be8-4d59-9dfb-93462f7b0895'} Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:00.488452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 while it is in vm_state rescued Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 while it is in vm_state rescued Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:00.490080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Returning 409 to user: Cannot 'detach_volume' instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 while it is in vm_state rescued {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:00.491267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d6f7c09c-0492-4b01-a1a2-0273e1095f26 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments/b6ea35cb-2be8-4d59-9dfb-93462f7b0895" status: 409 len: 152 microversion: 2.1 time: 0.102450 Jun 20 12:28:00.491267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 343/686] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:28:00 2022] DELETE /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments/b6ea35cb-2be8-4d59-9dfb-93462f7b0895 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 12:28:00.496906 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9e303ad0-ee30-4ccd-9103-11575c254bec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:00.497645 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9e303ad0-ee30-4ccd-9103-11575c254bec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:00.504354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9e303ad0-ee30-4ccd-9103-11575c254bec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.504902 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9e303ad0-ee30-4ccd-9103-11575c254bec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.505782 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9e303ad0-ee30-4ccd-9103-11575c254bec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.506311 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9e303ad0-ee30-4ccd-9103-11575c254bec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.822190 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9e303ad0-ee30-4ccd-9103-11575c254bec tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "POST /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/action" status: 202 len: 0 microversion: 2.1 time: 0.329010 Jun 20 12:28:00.822818 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 344/687] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:28:00 2022] POST /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:28:00.831211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:00.831824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:00.838015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.838619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.839223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:00.839662 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:00.969361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:00.978121 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b0d0b717-f2ce-4f9a-9a3c-b1a8eaa7a454 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.150937 Jun 20 12:28:00.978688 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 344/688] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:00 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:01.132989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:01.133729 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:01.140370 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:01.140947 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:01.141689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:01.142082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:01.285065 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:01.293275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-358ddbd2-0311-415e-8daf-546e55d8bc2e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.164551 Jun 20 12:28:01.293866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 345/689] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:01 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:01.996246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:01.996862 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:02.004554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.005118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.005963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.006394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.139996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:02.147956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-98c53bce-2714-4c04-8f0c-eb75ca54be94 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.155870 Jun 20 12:28:02.148510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 345/690] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:01 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:02.310286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:02.310897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:02.318134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.318582 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.319346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:02.319784 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:02.448003 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:02.455437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a135ee51-6d6d-4035-9e33-e3a665dc868a tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.148992 Jun 20 12:28:02.456134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 346/691] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:02 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:03.165525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:03.166146 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:03.172581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.173024 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.173791 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.174399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.345194 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:03.353883 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-aeb6eab1-26cc-4daa-97f1-9bcc1bfe38b3 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.192251 Jun 20 12:28:03.354442 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 346/692] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:03 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:03.521659 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:03.522327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:03.528536 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.528994 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.529769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:03.530227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:03.658568 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:03.666441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-717a5d24-59bd-47a3-8796-af850eee6d77 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.198029 Jun 20 12:28:03.667011 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 347/693] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:03 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:04.371029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:04.371571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:04.379124 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:04.379568 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:04.380321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:04.380751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:04.513440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:04.522256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8d3a6904-02a4-4f8b-a70c-4abab3700a35 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.155150 Jun 20 12:28:04.522823 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 347/694] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:04 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:04.684526 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:04.685036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:04.692499 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:04.692943 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:04.693692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:04.694151 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:04.826691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:04.835077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b4cdc432-6f10-4d67-b2bb-0c75641e17ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.154575 Jun 20 12:28:04.835633 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 348/695] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:04 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:05.539078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:05.539680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:05.546164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.546605 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:05.547358 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.547785 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:05.708825 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:05.716807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f286c3cf-7ac7-45fb-98f5-65329af912aa tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.181948 Jun 20 12:28:05.717367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 348/696] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:05 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:05.851887 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:05.852819 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:05.859465 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.860105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:05.860882 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:05.862036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:05.997269 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:06.006408 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f83c9c24-337b-4277-a8ed-98ab248bd669 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1359 microversion: 2.1 time: 0.158542 Jun 20 12:28:06.007314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 349/697] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:05 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:06.734539 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:06.735146 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:06.742185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:06.742630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:06.743382 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:06.743827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:06.872340 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:06.881034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ed1a46d3-3274-4694-975c-2ec8cc3c0c7b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.150409 Jun 20 12:28:06.881599 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 349/698] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:06 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:07.023979 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:07.024550 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:07.031297 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.031747 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.032519 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.032991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.168839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:07.177329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2f1d4ce9-cebd-474e-978a-26e6c33b6c0e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1545 microversion: 2.1 time: 0.157394 Jun 20 12:28:07.177923 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 350/699] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:07 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1545 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:07.193778 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2067fa3e-e093-4db8-8e53-44913d768baf tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:07.194439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2067fa3e-e093-4db8-8e53-44913d768baf tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:07.200423 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2067fa3e-e093-4db8-8e53-44913d768baf tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.200879 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2067fa3e-e093-4db8-8e53-44913d768baf tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.201656 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2067fa3e-e093-4db8-8e53-44913d768baf tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.202125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2067fa3e-e093-4db8-8e53-44913d768baf tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.287994 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2067fa3e-e093-4db8-8e53-44913d768baf tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098170 Jun 20 12:28:07.288588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 350/700] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:28:07 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:07.898713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:07.899332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:07.905663 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.906167 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:07.906937 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:07.907389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:08.037026 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:08.045030 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0680be52-b18c-4589-9d13-4b957d66c13a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.150243 Jun 20 12:28:08.045599 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 351/701] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:07 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:08.526209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-58c86432-78b4-4a81-b2f7-5e73266bce32 req-53584df2-7214-4e38-8de7-58154a2c60b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a19367-11da-40fa-b0e3-26d50b960479", "tag": "ea11fe30-3cec-4a76-bdd2-db108d460048"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:08.534584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-58c86432-78b4-4a81-b2f7-5e73266bce32 req-53584df2-7214-4e38-8de7-58154a2c60b0 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:08.535316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-58c86432-78b4-4a81-b2f7-5e73266bce32 req-53584df2-7214-4e38-8de7-58154a2c60b0 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:08.546547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-58c86432-78b4-4a81-b2f7-5e73266bce32 req-53584df2-7214-4e38-8de7-58154a2c60b0 service nova] Creating event network-changed:ea11fe30-3cec-4a76-bdd2-db108d460048 for instance 74a19367-11da-40fa-b0e3-26d50b960479 on hv-cinder-83697 Jun 20 12:28:08.551874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-58c86432-78b4-4a81-b2f7-5e73266bce32 req-53584df2-7214-4e38-8de7-58154a2c60b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029985 Jun 20 12:28:08.552633 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 351/702] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:09.062918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:09.063471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:09.070896 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:09.071342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:09.072134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:09.073060 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:09.250710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:09.259731 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-675fb90e-8b10-4580-8e3e-69480cd12460 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.200825 Jun 20 12:28:09.260386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 352/703] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:09 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:10.288341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:10.289035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:10.295999 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:10.296447 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:10.297212 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:10.297642 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:10.435642 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:10.444685 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c58a2adb-a5c5-4eb7-8a4c-4090c4a3d387 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.161406 Jun 20 12:28:10.445238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 352/704] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:10 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:11.461737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:11.462437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:11.468850 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:11.469294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:11.470110 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:11.470539 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:11.619683 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:11.628354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-71fed28f-a0a4-4f4a-96e5-4fc2cef993ae tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1723 microversion: 2.1 time: 0.170489 Jun 20 12:28:11.628920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 353/705] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:11 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:12.646125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:12.646746 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:12.653484 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.653967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:12.654740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.655174 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:12.786100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:12.794360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c0933d25-ea74-4b9a-a651-b1548a1aef9c tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1729 microversion: 2.1 time: 0.152760 Jun 20 12:28:12.795161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 353/706] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:12 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:12.810988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-aee7a4db-ae8a-44e0-9443-bff167d84991 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:12.811522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-aee7a4db-ae8a-44e0-9443-bff167d84991 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:12.813862 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:12.818928 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aee7a4db-ae8a-44e0-9443-bff167d84991 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.825200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aee7a4db-ae8a-44e0-9443-bff167d84991 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:12.825200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aee7a4db-ae8a-44e0-9443-bff167d84991 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:12.825200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-aee7a4db-ae8a-44e0-9443-bff167d84991 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:12.899993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-aee7a4db-ae8a-44e0-9443-bff167d84991 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092772 Jun 20 12:28:12.900623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 354/707] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:28:12 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:13.866068 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-52eec7c7-aaeb-48a4-84a4-ec71ed7f5204 req-bf3c03cc-b020-4bdb-8ce2-b1a68ae74183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4", "tag": "dfa767d1-2961-4d8b-8953-7eb7df3db7da"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:13.878251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-52eec7c7-aaeb-48a4-84a4-ec71ed7f5204 req-bf3c03cc-b020-4bdb-8ce2-b1a68ae74183 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:13.878895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-52eec7c7-aaeb-48a4-84a4-ec71ed7f5204 req-bf3c03cc-b020-4bdb-8ce2-b1a68ae74183 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:13.890128 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-52eec7c7-aaeb-48a4-84a4-ec71ed7f5204 req-bf3c03cc-b020-4bdb-8ce2-b1a68ae74183 service nova] Creating event network-changed:dfa767d1-2961-4d8b-8953-7eb7df3db7da for instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 on hv-cinder-83697 Jun 20 12:28:13.895846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-52eec7c7-aaeb-48a4-84a4-ec71ed7f5204 req-bf3c03cc-b020-4bdb-8ce2-b1a68ae74183 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033813 Jun 20 12:28:13.896472 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 354/708] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:28:13.967445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:13.967445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:13.971234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:13.971987 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:13.973239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:13.973904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:14.129350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lazy-loading 'services' on Instance uuid 8969b640-7480-4461-b210-d2c9ee794f9c {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:14.477885 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-46ad186f-5e85-4820-bc6f-f11ef99f8de9 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c/os-volume_attachments/2881def7-4e03-44f7-a306-2d7ee2664546" status: 202 len: 0 microversion: 2.1 time: 0.519375 Jun 20 12:28:14.478862 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 355/709] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:28:13 2022] DELETE /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c/os-volume_attachments/2881def7-4e03-44f7-a306-2d7ee2664546 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:28:15.913540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-b39909f5-a7fa-4a9c-9015-f69ea8472488 req-fc0593fd-4cd7-4cea-824a-0e7b39f70987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4", "tag": "dfa767d1-2961-4d8b-8953-7eb7df3db7da"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:15.921862 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b39909f5-a7fa-4a9c-9015-f69ea8472488 req-fc0593fd-4cd7-4cea-824a-0e7b39f70987 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:15.922315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b39909f5-a7fa-4a9c-9015-f69ea8472488 req-fc0593fd-4cd7-4cea-824a-0e7b39f70987 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:15.934845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-b39909f5-a7fa-4a9c-9015-f69ea8472488 req-fc0593fd-4cd7-4cea-824a-0e7b39f70987 service nova] Creating event network-changed:dfa767d1-2961-4d8b-8953-7eb7df3db7da for instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 on hv-cinder-83697 Jun 20 12:28:15.940142 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-b39909f5-a7fa-4a9c-9015-f69ea8472488 req-fc0593fd-4cd7-4cea-824a-0e7b39f70987 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031737 Jun 20 12:28:15.940711 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 355/710] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:28:16.653918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:16.654566 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:16.661846 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:16.662305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:16.663079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:16.663523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:16.688016 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:28:16.702587 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:17.049724 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5bd2245c-69dc-4298-a358-b6f02e2edba7 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 204 len: 0 microversion: 2.1 time: 0.399723 Jun 20 12:28:17.050357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 356/711] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:28:16 2022] DELETE /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:28:17.068238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:17.069038 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:17.075441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:17.075883 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:17.076661 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:17.077156 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:17.213976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:17.221745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6991b26a-2b98-47cd-adc2-bf4fc0446ef3 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1513 microversion: 2.1 time: 0.159403 Jun 20 12:28:17.225641 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 356/712] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:17 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:18.239868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:18.240558 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:18.247143 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:18.247591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.248354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:18.248794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:18.384039 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:18.391471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5c4ae8c0-730e-4afd-ab9b-dfaaa4f469ac tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1513 microversion: 2.1 time: 0.155883 Jun 20 12:28:18.392027 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 357/713] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:18 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:19.410550 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:19.410550 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:19.417175 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:19.417603 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:19.418392 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:19.418823 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:19.885517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-1eb411ad-fae8-4a01-aabd-52b13c556b6c req-5bb1e87d-30c8-4df8-a402-aa3fb6351e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8969b640-7480-4461-b210-d2c9ee794f9c", "name": "network-vif-deleted", "tag": "e51c046d-a57a-492a-932e-fab7af9242b1"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:19.887710 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:19.891244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=100 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:19.895248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1eb411ad-fae8-4a01-aabd-52b13c556b6c req-5bb1e87d-30c8-4df8-a402-aa3fb6351e64 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:19.895698 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1eb411ad-fae8-4a01-aabd-52b13c556b6c req-5bb1e87d-30c8-4df8-a402-aa3fb6351e64 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:19.897681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-766a2c69-507f-4a12-9b59-fcb89e6a74a1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1513 microversion: 2.1 time: 0.493126 Jun 20 12:28:19.898492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 357/714] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:19 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1513 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:19.906829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-1eb411ad-fae8-4a01-aabd-52b13c556b6c req-5bb1e87d-30c8-4df8-a402-aa3fb6351e64 service nova] Creating event network-vif-deleted:e51c046d-a57a-492a-932e-fab7af9242b1 for instance 8969b640-7480-4461-b210-d2c9ee794f9c on hv-cinder-83697 Jun 20 12:28:19.912840 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-1eb411ad-fae8-4a01-aabd-52b13c556b6c req-5bb1e87d-30c8-4df8-a402-aa3fb6351e64 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Jun 20 12:28:19.913495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 358/715] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:20.919974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:20.920537 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:20.922805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=58 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:20.928020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.928457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.929246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.929675 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.962029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:20.962472 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:20.962913 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lazy-loading 'fault' on Instance uuid 8969b640-7480-4461-b210-d2c9ee794f9c {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:21.003639 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ef23fbdb145bfa485859ff4c43b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b0e8111c084f769bbc267365364900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:21.011251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6f17615f-e3e2-4a54-b4b4-fc4017937fe1 tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 200 len: 1309 microversion: 2.1 time: 0.095716 Jun 20 12:28:21.018409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 358/716] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:20 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:22.030599 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:22.031302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] [instance: 8969b640-7480-4461-b210-d2c9ee794f9c] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:22.037891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.038343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:22.039134 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:22.039573 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:22.052288 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] HTTP exception thrown: Instance 8969b640-7480-4461-b210-d2c9ee794f9c could not be found. Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Request method failure captured: Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c HTTP/1.1 Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGdgxsJ4ZiUkjLX1dHdyl4qw4eGI2wK4ckn6pLOg8UWrH6_rDduiKQB62L4C7CpRX3AcBWJfmuq4B160NCTmdp6EZcUWY0Rr_z_rXm5IHgsYrfqV7Xrg7L_S_cYzCNZMt8EQ4ywZzArrgnox4wwJ-IhyL7BiAFWbgjgim_hwRFseSOM Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: d9b0e8111c084f769bbc267365364900 Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-VolumesSnapshotTestJSON-148872802 Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:28:22.053899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d9b0e8111c084f769bbc267365364900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d9b0e8111c084f769bbc267365364900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d9b0e8111c084f769bbc267365364900"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d9b0e8111c084f769bbc267365364900"}]}] Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-VolumesSnapshotTestJSON-148872802 Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: d9b0e8111c084f769bbc267365364900 Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-148872802 Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-VolumesSnapshotTestJSON-148872802-project Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 7c5ef23fbdb145bfa485859ff4c43b4c Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-VolumesSnapshotTestJSON-148872802-project Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 8969b640-7480-4461-b210-d2c9ee794f9c could not be found. Jun 20 12:28:22.055384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '8969b640-7480-4461-b210-d2c9ee794f9c'} Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8969b640-7480-4461-b210-d2c9ee794f9c could not be found. Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:22.056244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8969b640-7480-4461-b210-d2c9ee794f9c could not be found. Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8969b640-7480-4461-b210-d2c9ee794f9c could not be found. Jun 20 12:28:22.057913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:28:22.060329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] Returning 404 to user: Instance 8969b640-7480-4461-b210-d2c9ee794f9c could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:22.060329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-49ced14f-29fa-425e-86a7-aef81b114d8b tempest-VolumesSnapshotTestJSON-148872802 tempest-VolumesSnapshotTestJSON-148872802-project] 10.222.0.64 "GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c" status: 404 len: 111 microversion: 2.1 time: 0.029870 Jun 20 12:28:22.060329 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 359/717] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:22 2022] GET /compute/v2.1/servers/8969b640-7480-4461-b210-d2c9ee794f9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:28:27.690801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9ce69e76-15a3-489b-9813-66b74c1256cb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:27.691803 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9ce69e76-15a3-489b-9813-66b74c1256cb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:27.698138 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ce69e76-15a3-489b-9813-66b74c1256cb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.698584 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ce69e76-15a3-489b-9813-66b74c1256cb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:27.699388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ce69e76-15a3-489b-9813-66b74c1256cb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.699812 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9ce69e76-15a3-489b-9813-66b74c1256cb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:27.904195 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9ce69e76-15a3-489b-9813-66b74c1256cb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/action" status: 202 len: 0 microversion: 2.1 time: 0.218010 Jun 20 12:28:27.904857 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 359/718] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:28:27 2022] POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:28:27.914380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:27.915435 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:27.921572 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.922058 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:27.922824 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:27.923255 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:28.068352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:28.076394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c762b1fd-0dca-4be0-acc8-4b3ea9e71789 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1750 microversion: 2.1 time: 0.166297 Jun 20 12:28:28.076962 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 360/719] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:27 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:29.095971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:29.107181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:29.107181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.107181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.107181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:29.107551 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:29.248551 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:29.257636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4bc22078-3346-4050-9f55-b36741db8c23 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.166490 Jun 20 12:28:29.258225 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 360/720] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:29 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:30.275635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:30.276187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:30.282860 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:30.283340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:30.284189 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:30.284629 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:30.429865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:30.438169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5b837580-6fe7-4eff-a534-d7a2f2e52c98 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.166495 Jun 20 12:28:30.438735 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 361/721] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:30 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:31.456315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:31.456932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:31.463874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.464356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.465129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:31.465566 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:31.614650 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:31.622724 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-882c1e3e-251a-4be9-a3e0-a6a128ec930e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.170294 Jun 20 12:28:31.623282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 361/722] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:31 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:32.332441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2820400f-1145-4707-bcb8-8f58a03f06e4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:32.336114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2820400f-1145-4707-bcb8-8f58a03f06e4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:32.338925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2820400f-1145-4707-bcb8-8f58a03f06e4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.339375 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2820400f-1145-4707-bcb8-8f58a03f06e4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:32.340145 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2820400f-1145-4707-bcb8-8f58a03f06e4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.340582 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2820400f-1145-4707-bcb8-8f58a03f06e4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:32.364322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2820400f-1145-4707-bcb8-8f58a03f06e4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/ips" status: 200 len: 149 microversion: 2.1 time: 0.090173 Jun 20 12:28:32.364878 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 362/723] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:28:32 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:32.640483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:32.641094 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:32.647620 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.648073 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:32.648851 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:32.649279 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:32.793446 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:32.802125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8ea7388d-ba10-440c-8617-9d6fc3a5cd1a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.165527 Jun 20 12:28:32.802684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 362/724] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:32 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:33.820204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:33.820929 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:33.827586 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:33.828069 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:33.830114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:33.830114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:33.976366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:33.984672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-098737aa-45a7-48af-b84b-48a9ee3c511c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.168586 Jun 20 12:28:33.985274 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 363/725] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:33 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:34.142136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c5f454fb-9138-4e17-84e4-e382db3cf207 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7faabdd8-4831-42dc-a8da-810bd7b54fd7"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:34.143983 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c5f454fb-9138-4e17-84e4-e382db3cf207 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:34.150473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5f454fb-9138-4e17-84e4-e382db3cf207 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:34.150914 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5f454fb-9138-4e17-84e4-e382db3cf207 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:34.151693 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5f454fb-9138-4e17-84e4-e382db3cf207 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:34.152205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5f454fb-9138-4e17-84e4-e382db3cf207 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:35.002552 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:35.003077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:35.009532 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:35.010016 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:35.010781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:35.011221 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:35.153367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:35.162680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7b6d55ac-f370-4398-978a-a6e455ccf224 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.164128 Jun 20 12:28:35.163252 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 364/726] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:34 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:36.179659 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:36.180295 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:36.186842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:36.187299 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:36.188240 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:36.188681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:36.335064 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:36.343167 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d055e154-e159-412f-806b-15c4ab3ac7eb tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.167449 Jun 20 12:28:36.343768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 365/727] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:36 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:37.359635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:37.360323 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:37.367095 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:37.367541 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:37.368348 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:37.368784 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:37.402040 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c5f454fb-9138-4e17-84e4-e382db3cf207 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.263598 Jun 20 12:28:37.403044 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 363/728] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:28:34 2022] POST /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments => generated 194 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:37.513614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:37.522629 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5de93ea3-a91e-4cb9-8532-edc1ac8e672a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.166922 Jun 20 12:28:37.523223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 366/729] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:37 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:38.541897 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:38.542587 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:38.548709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:38.549156 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:38.550539 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:38.550971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:38.698343 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:38.706918 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e0608179-78e4-4487-8bc5-285ada000ff7 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.170070 Jun 20 12:28:38.707483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 364/730] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:38 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:39.725136 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:39.725753 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:39.732302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:39.732744 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:39.733509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:39.733974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:39.877012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:39.885488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b45c20b4-99e9-4dc3-8a84-c130fdc0d9a6 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.165212 Jun 20 12:28:39.886075 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 367/731] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:39 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:40.902494 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:40.903134 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:40.910179 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.910626 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:40.911385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:40.911818 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:41.056576 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:41.064749 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5a3b238f-a495-47fe-ad1a-24885f76c8f3 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.166220 Jun 20 12:28:41.070196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 365/732] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:40 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:42.083179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:42.083851 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:42.090829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:42.091275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:42.092044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:42.092530 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:42.238975 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:42.247111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-99ab7444-62c7-48e9-803a-fb4ca24e3d93 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.168896 Jun 20 12:28:42.247689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 368/733] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:42 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:43.264306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:43.264945 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:43.272738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:43.273211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:43.274004 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:43.274432 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:43.421928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:43.430840 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d1bf1107-3e54-4d0a-9f28-851d9c40fa57 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.170393 Jun 20 12:28:43.431405 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 366/734] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:43 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:44.448181 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:44.448797 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:44.451265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:44.456923 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.457382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.458197 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.458673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.603726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:44.613270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-14a88ff8-396d-4304-9bdd-edbffeae042a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.168839 Jun 20 12:28:44.613879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 369/735] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:44 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:44.889540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7faabdd8-4831-42dc-a8da-810bd7b54fd7"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:44.890606 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:44.898091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.898525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.899280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:44.899707 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:44.981122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Invalid volume: volume 7faabdd8-4831-42dc-a8da-810bd7b54fd7 is already attached to instances: d46973eb-c676-4cd1-9b9b-5e4a2943c518 Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: POST /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments HTTP/1.1 Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 74 Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:28:44.982898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {"volumeAttachment": {"volumeId": "7faabdd8-4831-42dc-a8da-810bd7b54fd7"}} Jun 20 12:28:44.984579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Invalid volume: volume 7faabdd8-4831-42dc-a8da-810bd7b54fd7 is already attached to instances: d46973eb-c676-4cd1-9b9b-5e4a2943c518 Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'server_id': 'd46973eb-c676-4cd1-9b9b-5e4a2943c518', 'body': {'volumeAttachment': {'volumeId': '7faabdd8-4831-42dc-a8da-810bd7b54fd7'}}} Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7faabdd8-4831-42dc-a8da-810bd7b54fd7 is already attached to instances: d46973eb-c676-4cd1-9b9b-5e4a2943c518 Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:44.985509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7faabdd8-4831-42dc-a8da-810bd7b54fd7 is already attached to instances: d46973eb-c676-4cd1-9b9b-5e4a2943c518 Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:44.987476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7faabdd8-4831-42dc-a8da-810bd7b54fd7 is already attached to instances: d46973eb-c676-4cd1-9b9b-5e4a2943c518 Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 400 to user: Invalid volume: volume 7faabdd8-4831-42dc-a8da-810bd7b54fd7 is already attached to instances: d46973eb-c676-4cd1-9b9b-5e4a2943c518 {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6289cf1f-632b-426f-a4c8-5bac5b920bcd tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098857 Jun 20 12:28:44.988917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 367/736] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:28:44 2022] POST /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:28:45.052342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:45.052849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:45.059195 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.064514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.064514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.064514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.147679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'services' on Instance uuid d46973eb-c676-4cd1-9b9b-5e4a2943c518 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:45.413689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b9d6d7ec-0b7f-4980-86ac-ae0834c029f3 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments/7faabdd8-4831-42dc-a8da-810bd7b54fd7" status: 202 len: 0 microversion: 2.1 time: 0.365475 Jun 20 12:28:45.414237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 370/737] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:28:45 2022] DELETE /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments/7faabdd8-4831-42dc-a8da-810bd7b54fd7 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:28:45.422704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2115ec43-af79-46cd-b4d3-182e46563fd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:45.423693 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2115ec43-af79-46cd-b4d3-182e46563fd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:45.429966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2115ec43-af79-46cd-b4d3-182e46563fd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.430532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2115ec43-af79-46cd-b4d3-182e46563fd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.431371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2115ec43-af79-46cd-b4d3-182e46563fd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.431814 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2115ec43-af79-46cd-b4d3-182e46563fd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.462271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2115ec43-af79-46cd-b4d3-182e46563fd2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Jun 20 12:28:45.462872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 368/738] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:28:45 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:45.632251 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:45.633072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:45.639347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.639892 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.640664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:45.641111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:45.794558 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:45.803762 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-06b6a0b3-fbcf-41df-909f-c29c9e0b727c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.176802 Jun 20 12:28:45.804385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 371/739] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:45 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:46.474359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4ff384e9-04ed-4926-b5fd-ef9a6ba51ef2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:46.475279 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4ff384e9-04ed-4926-b5fd-ef9a6ba51ef2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:46.481771 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ff384e9-04ed-4926-b5fd-ef9a6ba51ef2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.482244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ff384e9-04ed-4926-b5fd-ef9a6ba51ef2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.483003 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ff384e9-04ed-4926-b5fd-ef9a6ba51ef2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.483440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ff384e9-04ed-4926-b5fd-ef9a6ba51ef2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.514643 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4ff384e9-04ed-4926-b5fd-ef9a6ba51ef2 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Jun 20 12:28:46.515275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 369/740] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:28:46 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:46.820780 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:46.821416 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:46.829537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.830062 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.831500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:46.831934 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:46.975560 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:46.977863 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:46.984092 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-28e59d54-7c22-48b1-9c71-a6988444438a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.167215 Jun 20 12:28:46.984657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 372/741] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:46 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:47.526562 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b97227c9-a813-4105-833f-dfd9bf454257 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:47.527481 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b97227c9-a813-4105-833f-dfd9bf454257 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:47.534139 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b97227c9-a813-4105-833f-dfd9bf454257 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.534582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b97227c9-a813-4105-833f-dfd9bf454257 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.535339 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b97227c9-a813-4105-833f-dfd9bf454257 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.535771 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b97227c9-a813-4105-833f-dfd9bf454257 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.565311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b97227c9-a813-4105-833f-dfd9bf454257 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042428 Jun 20 12:28:47.565995 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 370/742] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:28:47 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:28:47.623603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:47.624096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:47.631339 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.635780 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.635780 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.635780 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.657131 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:28:47.946569 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6ca3f331-5efd-4ac0-b73f-cc8aa506cad7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 204 len: 0 microversion: 2.1 time: 0.326912 Jun 20 12:28:47.947265 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 373/743] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:28:47 2022] DELETE /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:28:47.955459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:47.956505 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:47.962327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.962769 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:47.963525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:47.963963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:48.003289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:48.004028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:48.010357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:48.010813 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:48.011594 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:48.012036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:48.098560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:48.102063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:48.106667 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c5a9a188-a081-4a74-8601-d22ddf9197b8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1681 microversion: 2.1 time: 0.155129 Jun 20 12:28:48.107239 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 371/744] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:47 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:48.162818 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:48.170690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-670c6b79-b431-45e9-a6af-04e6e595808e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.172338 Jun 20 12:28:48.171250 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 374/745] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:47 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:49.125374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:49.126007 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:49.134303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:49.134756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:49.135624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:49.136069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:49.188695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:49.189542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:49.197024 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:49.197486 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:49.198308 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:49.198761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:49.282631 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:49.293575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3a7b2a09-19d7-4f8a-bf63-efaedb34587f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1681 microversion: 2.1 time: 0.170645 Jun 20 12:28:49.293575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 372/746] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:49 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:49.359886 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:49.370439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-31c7bee5-77b8-446d-bf6e-07c9350d8397 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.185766 Jun 20 12:28:49.371140 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 375/747] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:49 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:50.310706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:50.311354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:50.318998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:50.319453 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:50.320269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:50.320710 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:50.395444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:50.396898 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:50.405176 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:50.406153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:50.407221 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:50.407752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:50.428530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:50.442713 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f26a9a5e-6dc9-459f-ae5a-d1860e880328 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1614 microversion: 2.1 time: 0.135743 Jun 20 12:28:50.444171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 373/748] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:50 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1614 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:50.565533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:50.573724 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-de87f073-12a7-4d88-baad-bb9aa930345b tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.184338 Jun 20 12:28:50.574611 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 376/749] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:50 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:50.883512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-c893ec60-c708-4fbe-b3f5-289c5db18af1 req-684cedd0-e4de-407e-af8a-ab63c2f70fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46973eb-c676-4cd1-9b9b-5e4a2943c518", "name": "network-vif-deleted", "tag": "ead77c80-977e-4a4c-904f-7d880c8e28a3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:50.893098 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-c893ec60-c708-4fbe-b3f5-289c5db18af1 req-684cedd0-e4de-407e-af8a-ab63c2f70fb1 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:50.893959 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-c893ec60-c708-4fbe-b3f5-289c5db18af1 req-684cedd0-e4de-407e-af8a-ab63c2f70fb1 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:50.928259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-c893ec60-c708-4fbe-b3f5-289c5db18af1 req-684cedd0-e4de-407e-af8a-ab63c2f70fb1 service nova] Creating event network-vif-deleted:ead77c80-977e-4a4c-904f-7d880c8e28a3 for instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 on hv-cinder-83697 Jun 20 12:28:50.928259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-c893ec60-c708-4fbe-b3f5-289c5db18af1 req-684cedd0-e4de-407e-af8a-ab63c2f70fb1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223363 Jun 20 12:28:50.928259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 374/750] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:51.333768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:51.334371 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:51.340405 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.340859 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.341746 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.342224 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.366955 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lazy-loading 'flavor' on Instance uuid b53262aa-7cf3-44ef-a688-cac5131e08bb {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:51.461589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:51.462309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:51.468628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.469057 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.469907 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.470379 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.504882 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.505410 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.505917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'fault' on Instance uuid d46973eb-c676-4cd1-9b9b-5e4a2943c518 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:51.551702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:51.559510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4fe6e9aa-1b9e-469d-9156-ace71e6d92cf tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1332 microversion: 2.1 time: 0.102652 Jun 20 12:28:51.560087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 375/751] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:51 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:51.592193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:51.592918 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:51.600182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.600681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.601548 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.602014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.739635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ec80c5b8-de57-4ff8-bdc9-7f5756cd8903 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "POST /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb/action" status: 202 len: 0 microversion: 2.1 time: 0.409980 Jun 20 12:28:51.740832 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 377/752] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:28:51 2022] POST /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:28:51.749437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:51.750154 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:51.755925 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:51.756765 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.757232 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.758040 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:51.758479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:51.764176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4ed5e1ea-ae71-4858-bd34-d4c93d4d738d tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1755 microversion: 2.1 time: 0.176022 Jun 20 12:28:51.764744 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 376/753] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:51 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:51.895938 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:51.903491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d00a067d-4f4a-4442-840a-75c1cd3fc508 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.158121 Jun 20 12:28:51.904052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 378/754] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:51 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:52.576545 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:52.577158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:52.584215 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.584665 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.585483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.585961 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.619935 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.620310 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.620761 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'fault' on Instance uuid d46973eb-c676-4cd1-9b9b-5e4a2943c518 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:28:52.662195 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:52.669377 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-cc2c1c68-4f2c-41c1-b311-40eb715d98dc tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 200 len: 1332 microversion: 2.1 time: 0.096801 Jun 20 12:28:52.669972 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 377/755] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:52 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:52.782487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:52.783099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:52.790442 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.790971 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.791737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.792173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.922334 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:52.922975 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:52.930568 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.931015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:52.931819 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:52.932277 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:53.067318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:53.075591 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bd597e2e-f1d0-4066-8f1b-71ac353f6af0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.157036 Jun 20 12:28:53.076381 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 378/756] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:52 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:53.092517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:53.101670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2547c2a1-79bc-4819-9173-7baa1a07d54c tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1758 microversion: 2.1 time: 0.323124 Jun 20 12:28:53.102263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 379/757] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:52 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1758 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:28:53.687337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:53.687952 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:53.695296 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:53.695740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:53.696507 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:53.696976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:53.711426 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 HTTP/1.1 Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:28:53.713168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:28:53.714804 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'd46973eb-c676-4cd1-9b9b-5e4a2943c518'} Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:28:53.715625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:28:53.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:28:53.718477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:28:53.718477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3bde699d-78e1-45f8-bb72-af67e962127b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 404 len: 111 microversion: 2.1 time: 0.031281 Jun 20 12:28:53.718477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 379/758] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:53 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:28:53.724085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ee960428-25e6-4633-9e50-ff939e4bfa36 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '.version_select at 0x7fe283fa6040>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:53.803386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ee960428-25e6-4633-9e50-ff939e4bfa36 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161976094" status: 202 len: 0 microversion: 2.1 time: 0.083672 Jun 20 12:28:53.804007 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 380/759] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 20 12:28:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1161976094 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:28:54.097065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:54.097065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:54.102540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:54.103000 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.104395 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:54.104840 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:54.349089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:54.356749 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-344b3fde-3895-4372-947f-c7aa0d0abee1 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.267057 Jun 20 12:28:54.357499 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 380/760] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:54 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:54.665015 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0de691f2-1601-4170-a6e5-9b585a8d8021 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: .version_select at 0x7fe283fbc940>, body: {"keypair": {"name": "tempest-keypair-270100773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaEPINHHP22D9/leML+f/RvPvVp7wWBCEzBA1BiiwIGo1Pn6BYE1dOmKM9zZnV7lWzE7CVwkepWYYIVappy+SrOykAYw8AzFUUytPH/3DT+m9pRqdDSTS5ZxbaF+2LYCw=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:54.680057 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-0de691f2-1601-4170-a6e5-9b585a8d8021 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:54.683980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-0de691f2-1601-4170-a6e5-9b585a8d8021 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:54.816274 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0de691f2-1601-4170-a6e5-9b585a8d8021 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155598 Jun 20 12:28:54.816986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 381/761] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 20 12:28:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:55.375205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:55.375724 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:55.383144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.383617 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.384494 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.384932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.534861 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:55.542971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ba39075f-cc42-48d2-8602-1b6fadafdea0 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.171924 Jun 20 12:28:55.543567 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 381/762] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:55 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:55.899575 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0734b93a-a15c-4f85-b767-02285a7d18ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:55.900098 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0734b93a-a15c-4f85-b767-02285a7d18ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:55.906173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0734b93a-a15c-4f85-b767-02285a7d18ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.908897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0734b93a-a15c-4f85-b767-02285a7d18ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.908897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0734b93a-a15c-4f85-b767-02285a7d18ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:55.908897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0734b93a-a15c-4f85-b767-02285a7d18ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:55.931578 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0734b93a-a15c-4f85-b767-02285a7d18ce tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/ips" status: 200 len: 146 microversion: 2.1 time: 0.036968 Jun 20 12:28:55.933316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 382/763] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:28:55 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:28:56.560694 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:56.561356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:56.570187 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.571124 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:56.572107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:56.572686 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:56.712575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:56.721324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-02c092cc-2ff1-4755-8bc4-576382c1d731 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.164537 Jun 20 12:28:56.726144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 382/764] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:56 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:57.506564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1676456677", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25ad919b-444d-4364-9171-7dcb6a499f3f"}], "security_groups": [{"name": "tempest-securitygroup--1294546715"}], "key_name": "tempest-keypair-270100773", "user_data": "}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:57.610481 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] validate_networks() for [('25ad919b-444d-4364-9171-7dcb6a499f3f', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:28:57.652936 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c56ce7f0-b5f4-4582-a503-9325ca93318e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dfb70f0-9a3b-4db5-8a39-a827db92b2d0"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:28:57.654111 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c56ce7f0-b5f4-4582-a503-9325ca93318e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:57.661367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c56ce7f0-b5f4-4582-a503-9325ca93318e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:57.661845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c56ce7f0-b5f4-4582-a503-9325ca93318e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:57.662874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c56ce7f0-b5f4-4582-a503-9325ca93318e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:57.663316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c56ce7f0-b5f4-4582-a503-9325ca93318e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:58.087904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:28:58.088326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:28:58.088800 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:28:58.089209 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:28:58.089615 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:28:58.098967 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:58.099410 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:58.102055 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:58.102055 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:58.117560 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:28:58.121450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Getting quotas for user 787efd65008840748e98f9e46e11a1eb and project 2f5df9a6a9764dde96014824c7456331. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:28:58.133088 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:28:58.135373 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:28:58.270015 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-93e3b301-f36d-435a-964d-15e4b70a35f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.768487 Jun 20 12:28:58.270584 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 383/765] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:28:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:28:58.275088 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:58.275772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:58.282600 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:58.283044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:58.284548 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:58.285968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:58.436151 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:58.444227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8f24569c-5de0-49cc-98db-8b34b0e73287 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.172665 Jun 20 12:28:58.444974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 384/766] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:58 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:58.449333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2d043f2d-4e78-430c-9385-dd76df3acb87 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:58.450783 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2d043f2d-4e78-430c-9385-dd76df3acb87 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:58.498483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c56ce7f0-b5f4-4582-a503-9325ca93318e tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848934 Jun 20 12:28:58.499463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 383/767] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:28:57 2022] POST /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:28:58.511008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2d043f2d-4e78-430c-9385-dd76df3acb87 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:58.522188 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2d043f2d-4e78-430c-9385-dd76df3acb87 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1241 microversion: 2.1 time: 0.076311 Jun 20 12:28:58.522797 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 385/768] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:58 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:59.462213 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:59.462900 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:59.465315 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=58 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:59.470290 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.470727 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.472440 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.472870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.540385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:28:59.541020 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:28:59.548389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.549043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.550606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:28:59.551051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:28:59.614649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:59.621776 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:28:59.622647 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d8cbff88-5e42-467e-8707-770bec5bed77 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.164618 Jun 20 12:28:59.623225 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 384/769] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:59 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:28:59.630218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-180eb5bc-41a7-4ac7-896a-5e5de4772818 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1245 microversion: 2.1 time: 0.093982 Jun 20 12:28:59.631305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 386/770] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:28:59 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:00.642107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:00.648104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:00.648851 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:00.653011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:00.660252 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.660701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.661483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.661959 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.669378 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.669844 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.670526 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:00.670966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:00.748788 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:00.756629 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ece3bbd8-8abd-424d-9dc2-9b668e0bbf40 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1301 microversion: 2.1 time: 0.112563 Jun 20 12:29:00.757204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 387/771] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:00 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:00.895213 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:00.903117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d0287984-367e-4b08-b7a3-6fcb1dcb9f3a tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.266636 Jun 20 12:29:00.903690 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 385/772] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:00 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:01.311215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:01.311805 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:01.318709 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.319166 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.319941 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.320379 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.402547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lazy-loading 'services' on Instance uuid f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:01.672687 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-594b2802-b24c-47bb-b781-a2cd6b68e61f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments/b6ea35cb-2be8-4d59-9dfb-93462f7b0895" status: 202 len: 0 microversion: 2.1 time: 0.365125 Jun 20 12:29:01.677237 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 388/773] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:29:01 2022] DELETE /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments/b6ea35cb-2be8-4d59-9dfb-93462f7b0895 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:01.683717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f52468cd-c56e-43b6-ae33-ce8b098de021 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:01.686953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f52468cd-c56e-43b6-ae33-ce8b098de021 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:01.695021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f52468cd-c56e-43b6-ae33-ce8b098de021 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.695646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f52468cd-c56e-43b6-ae33-ce8b098de021 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.696553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f52468cd-c56e-43b6-ae33-ce8b098de021 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.697053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f52468cd-c56e-43b6-ae33-ce8b098de021 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.731898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f52468cd-c56e-43b6-ae33-ce8b098de021 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050206 Jun 20 12:29:01.731898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 386/774] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:01 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:01.774674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:01.775293 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:01.782292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.787710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.787710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.787710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.791081 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:01.922302 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:01.923064 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:01.933350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:01.935864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.936420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.937468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:01.939201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:01.944360 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-be9fc7e9-bf46-4ffb-b6ba-6d6733108289 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.173672 Jun 20 12:29:01.944944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 389/775] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:01 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:02.103304 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:02.106723 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:02.111552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-519704f6-d192-4980-86b2-56a12ddc690e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.193359 Jun 20 12:29:02.112126 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 387/776] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:01 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:02.468890 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-684cf130-e2d3-40a7-babb-9ea37c99f99c req-2dbbc4e6-c3e8-4bfb-8139-ccfc50f745e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52dbe69-b2da-4efe-a1ee-2559900a2632", "tag": "8d767632-02a0-41c1-b527-257611deb664"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:02.478680 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-684cf130-e2d3-40a7-babb-9ea37c99f99c req-2dbbc4e6-c3e8-4bfb-8139-ccfc50f745e9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.479351 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-684cf130-e2d3-40a7-babb-9ea37c99f99c req-2dbbc4e6-c3e8-4bfb-8139-ccfc50f745e9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.492539 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-684cf130-e2d3-40a7-babb-9ea37c99f99c req-2dbbc4e6-c3e8-4bfb-8139-ccfc50f745e9 service nova] Creating event network-changed:8d767632-02a0-41c1-b527-257611deb664 for instance a52dbe69-b2da-4efe-a1ee-2559900a2632 on hv-cinder-83697 Jun 20 12:29:02.497645 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-684cf130-e2d3-40a7-babb-9ea37c99f99c req-2dbbc4e6-c3e8-4bfb-8139-ccfc50f745e9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032076 Jun 20 12:29:02.498476 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 390/777] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:02.741117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-01118bf4-c8c5-472c-8332-b6f4d1910e53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:02.742092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-01118bf4-c8c5-472c-8332-b6f4d1910e53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:02.749673 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01118bf4-c8c5-472c-8332-b6f4d1910e53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.750158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01118bf4-c8c5-472c-8332-b6f4d1910e53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.750947 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01118bf4-c8c5-472c-8332-b6f4d1910e53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.751389 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-01118bf4-c8c5-472c-8332-b6f4d1910e53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.793120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-01118bf4-c8c5-472c-8332-b6f4d1910e53 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056235 Jun 20 12:29:02.793705 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 388/778] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:02 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:02.966158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:02.966894 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:02.974604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.975052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:02.976003 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:02.976437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:03.128483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:03.129200 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:03.136357 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:03.136810 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:03.137588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:03.138056 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:03.214376 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:03.222783 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6f8f68a3-5e1d-42cb-ba17-f0177fe1f497 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.261591 Jun 20 12:29:03.223782 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 391/779] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:02 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:03.414806 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:03.423316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1499a14c-631e-4f07-9a54-c50e771ef8e4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.298650 Jun 20 12:29:03.423894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 389/780] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:03 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:03.805079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4e6a1458-5430-4732-880d-63d8362a1c52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:03.806776 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4e6a1458-5430-4732-880d-63d8362a1c52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:03.812930 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4e6a1458-5430-4732-880d-63d8362a1c52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:03.813377 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4e6a1458-5430-4732-880d-63d8362a1c52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:03.815500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4e6a1458-5430-4732-880d-63d8362a1c52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:03.816220 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4e6a1458-5430-4732-880d-63d8362a1c52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:03.851942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4e6a1458-5430-4732-880d-63d8362a1c52 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050065 Jun 20 12:29:03.852761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 392/781] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:03 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:04.240312 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:04.240919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:04.247538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.248018 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.248974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.249237 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.379782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:04.387085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ba95b4e2-c5b7-42ce-a3b5-2f615018fd20 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.151318 Jun 20 12:29:04.387639 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 390/782] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:04 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:04.441392 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:04.442052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:04.448447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.448890 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.449643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.450103 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.583740 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:04.591376 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-bab2b59f-73c9-43a4-b6f0-91a3f91890f2 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.154871 Jun 20 12:29:04.591944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 393/783] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:04 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:04.865089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e2ca30f8-8d7e-4264-b28d-ff409a07af32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:04.866039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e2ca30f8-8d7e-4264-b28d-ff409a07af32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:04.872267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2ca30f8-8d7e-4264-b28d-ff409a07af32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.872719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2ca30f8-8d7e-4264-b28d-ff409a07af32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.873482 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2ca30f8-8d7e-4264-b28d-ff409a07af32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:04.873957 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2ca30f8-8d7e-4264-b28d-ff409a07af32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:04.903240 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e2ca30f8-8d7e-4264-b28d-ff409a07af32 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043027 Jun 20 12:29:04.903810 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 391/784] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:04 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:05.404794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:05.405446 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:05.412335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.420603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.420603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.420603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.543544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:05.551980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-05de35b0-6322-4b81-a0e6-74276ba26d29 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.151499 Jun 20 12:29:05.552603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 394/785] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:05 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:05.608485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:05.609125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:05.616227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.616710 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.617499 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.617965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.750451 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:05.758006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9cc80129-e834-4ff4-98f6-307274939938 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.153343 Jun 20 12:29:05.758686 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 392/786] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:05 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:05.915834 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dc785962-85f1-4f5d-b73e-ec240b86825a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:05.916758 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dc785962-85f1-4f5d-b73e-ec240b86825a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:05.922794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc785962-85f1-4f5d-b73e-ec240b86825a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.923239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc785962-85f1-4f5d-b73e-ec240b86825a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.923999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc785962-85f1-4f5d-b73e-ec240b86825a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:05.924464 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dc785962-85f1-4f5d-b73e-ec240b86825a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:05.955217 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-dc785962-85f1-4f5d-b73e-ec240b86825a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Jun 20 12:29:05.956403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 395/787] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:05 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:06.570171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:06.570781 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:06.576792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.577233 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.578019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.578451 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.707254 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:06.714681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-11187c18-bbd8-4d21-988e-1c7c8d3cc845 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.149642 Jun 20 12:29:06.715244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 393/788] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:06 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:06.775330 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:06.776084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:06.782393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.782838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.783637 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.784490 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.926817 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:06.934967 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-84e5766c-9280-4065-9636-825c798b8d4d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.163443 Jun 20 12:29:06.935801 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 396/789] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:06 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:06.968505 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ead34e10-4350-4e56-8302-6501d91ba350 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:06.969475 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ead34e10-4350-4e56-8302-6501d91ba350 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:06.976142 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ead34e10-4350-4e56-8302-6501d91ba350 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.976594 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ead34e10-4350-4e56-8302-6501d91ba350 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:06.977362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ead34e10-4350-4e56-8302-6501d91ba350 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:06.977822 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ead34e10-4350-4e56-8302-6501d91ba350 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:07.010223 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ead34e10-4350-4e56-8302-6501d91ba350 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Jun 20 12:29:07.011033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 394/790] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:06 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:07.732623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:07.733166 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:07.739289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.739735 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:07.740504 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.740989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:07.871865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:07.881386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f7edaba3-225e-43d4-9079-181c6f280439 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.151072 Jun 20 12:29:07.881386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 397/791] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:07 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:07.952457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:07.953071 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:07.959831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.960400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:07.961242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:07.961726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.023530 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2714b936-ebd5-4b96-ab41-74d7dc8b48fc tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:08.024380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2714b936-ebd5-4b96-ab41-74d7dc8b48fc tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:08.030534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714b936-ebd5-4b96-ab41-74d7dc8b48fc tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.030986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714b936-ebd5-4b96-ab41-74d7dc8b48fc tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.036703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714b936-ebd5-4b96-ab41-74d7dc8b48fc tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.036703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714b936-ebd5-4b96-ab41-74d7dc8b48fc tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.079812 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2714b936-ebd5-4b96-ab41-74d7dc8b48fc tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057076 Jun 20 12:29:08.081348 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 398/792] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:08 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:08.109117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:08.118188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8fbdadec-74c8-4125-a17f-e93ea34725e9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.169587 Jun 20 12:29:08.118762 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 395/793] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:07 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:08.193150 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e3fee9be-cb7c-4b2c-b6eb-957ac15c0c1f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:08.194108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e3fee9be-cb7c-4b2c-b6eb-957ac15c0c1f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:08.196079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:08.201036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3fee9be-cb7c-4b2c-b6eb-957ac15c0c1f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.201486 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3fee9be-cb7c-4b2c-b6eb-957ac15c0c1f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.202287 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3fee9be-cb7c-4b2c-b6eb-957ac15c0c1f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.202727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3fee9be-cb7c-4b2c-b6eb-957ac15c0c1f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.234558 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e3fee9be-cb7c-4b2c-b6eb-957ac15c0c1f tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Jun 20 12:29:08.237947 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 399/794] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:08 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:08.246235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e9a7246b-1221-4375-88e5-22259da36f74 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:08.252868 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e9a7246b-1221-4375-88e5-22259da36f74 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:08.253677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9a7246b-1221-4375-88e5-22259da36f74 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.254147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9a7246b-1221-4375-88e5-22259da36f74 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.254915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9a7246b-1221-4375-88e5-22259da36f74 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.255591 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e9a7246b-1221-4375-88e5-22259da36f74 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.285516 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e9a7246b-1221-4375-88e5-22259da36f74 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/7dfb70f0-9a3b-4db5-8a39-a827db92b2d0" status: 200 len: 194 microversion: 2.1 time: 0.043501 Jun 20 12:29:08.286054 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 396/795] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jun 20 12:29:08 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/7dfb70f0-9a3b-4db5-8a39-a827db92b2d0 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:08.897605 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:08.898271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:08.900083 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=12 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:08.905464 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.905950 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:08.906871 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:08.907305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.055119 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:09.062764 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-179f6bbd-3c09-4cde-970e-420e45f9cece tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.170250 Jun 20 12:29:09.063687 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 400/796] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:08 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:09.092202 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a09c2f2c-4ffc-422d-b397-d11b549efa7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:09.093137 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a09c2f2c-4ffc-422d-b397-d11b549efa7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:09.100718 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09c2f2c-4ffc-422d-b397-d11b549efa7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.101169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09c2f2c-4ffc-422d-b397-d11b549efa7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.101984 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09c2f2c-4ffc-422d-b397-d11b549efa7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.102420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09c2f2c-4ffc-422d-b397-d11b549efa7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.132154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a09c2f2c-4ffc-422d-b397-d11b549efa7a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043966 Jun 20 12:29:09.133010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 397/797] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:09 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:29:09.148150 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:09.148805 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:09.154611 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:09.156454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.157099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.158195 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.159650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.225367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:09.225993 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:09.232285 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.233065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.234152 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.234684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.266617 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:29:09.320327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:09.328001 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cf59982c-1f65-44cb-946f-162de6c21d63 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1509 microversion: 2.1 time: 0.194010 Jun 20 12:29:09.328567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 401/798] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:09 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:09.392794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-4a7156d6-b178-4ec2-9eba-b1a6708fb515 req-5bff3870-66c1-47f9-85f6-dc4dba9a1d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52dbe69-b2da-4efe-a1ee-2559900a2632", "name": "network-vif-plugged", "status": "completed", "tag": "8d767632-02a0-41c1-b527-257611deb664"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:09.401598 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-4a7156d6-b178-4ec2-9eba-b1a6708fb515 req-5bff3870-66c1-47f9-85f6-dc4dba9a1d10 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.402192 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-4a7156d6-b178-4ec2-9eba-b1a6708fb515 req-5bff3870-66c1-47f9-85f6-dc4dba9a1d10 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.413421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-4a7156d6-b178-4ec2-9eba-b1a6708fb515 req-5bff3870-66c1-47f9-85f6-dc4dba9a1d10 service nova] Creating event network-vif-plugged:8d767632-02a0-41c1-b527-257611deb664 for instance a52dbe69-b2da-4efe-a1ee-2559900a2632 on hv-cinder-83697 Jun 20 12:29:09.419006 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-4a7156d6-b178-4ec2-9eba-b1a6708fb515 req-5bff3870-66c1-47f9-85f6-dc4dba9a1d10 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089172 Jun 20 12:29:09.419808 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 402/799] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:09.425255 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7dba8e2b-ef4c-4443-84dc-52decf14f72d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:09.425942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7dba8e2b-ef4c-4443-84dc-52decf14f72d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:09.432258 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7dba8e2b-ef4c-4443-84dc-52decf14f72d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.436141 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7dba8e2b-ef4c-4443-84dc-52decf14f72d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.436141 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7dba8e2b-ef4c-4443-84dc-52decf14f72d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.436141 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7dba8e2b-ef4c-4443-84dc-52decf14f72d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.748411 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7dba8e2b-ef4c-4443-84dc-52decf14f72d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "POST /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb/action" status: 202 len: 0 microversion: 2.1 time: 0.327487 Jun 20 12:29:09.752333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 403/800] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:29:09 2022] POST /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:09.757694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:09.758348 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:09.764189 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.764636 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.765414 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.765883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.783713 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-88d9b8d3-6518-4f81-9705-e4127f7ac07d tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 204 len: 0 microversion: 2.1 time: 0.560456 Jun 20 12:29:09.783713 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 398/801] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:09 2022] DELETE /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:29:09.791581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:09.792418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:09.798496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.799060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.800484 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:09.800986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:09.914277 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:09.923469 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-49eb209c-bd79-4f64-938f-e44721727322 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1517 microversion: 2.1 time: 0.169558 Jun 20 12:29:09.926811 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 404/802] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:09 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:09.951840 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:09.959826 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-32c18306-1963-4937-b0b1-e7d676c55434 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1689 microversion: 2.1 time: 0.172796 Jun 20 12:29:09.960153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 399/803] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:09 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:10.030981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b601e0d8-cf55-465b-8d43-1df43bc59083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8033f742-ca08-438e-a2b0-e91e7f338202"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:10.032052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b601e0d8-cf55-465b-8d43-1df43bc59083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:10.039609 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b601e0d8-cf55-465b-8d43-1df43bc59083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.040065 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b601e0d8-cf55-465b-8d43-1df43bc59083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.040845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b601e0d8-cf55-465b-8d43-1df43bc59083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.041316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b601e0d8-cf55-465b-8d43-1df43bc59083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.081574 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:10.081574 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:10.087245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.087702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.088492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.088930 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.234311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:10.242970 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-391884fe-4244-4627-beec-2286458feafe tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.167062 Jun 20 12:29:10.243533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 400/804] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:10 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:10.942439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:10.943029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:10.949211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.952498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:10.952498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:10.952498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.085035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:11.092560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2a8106bd-a812-4e05-85c3-234a9a7c61be tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1517 microversion: 2.1 time: 0.154178 Jun 20 12:29:11.093116 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 401/805] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:10 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:11.098061 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:11.098658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:11.104158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.104588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.105343 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.105775 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.234050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:11.237969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:11.242390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6e83e2b4-94b8-4215-b779-330f95710c09 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1689 microversion: 2.1 time: 0.148343 Jun 20 12:29:11.242953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 402/806] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:11 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:11.259427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:11.260033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:11.265971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.266419 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.267185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.267662 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.399202 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:11.406598 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-57ff1eab-4aa7-492a-9978-73af7298236b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.150769 Jun 20 12:29:11.407165 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 403/807] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:11 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:11.435266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-ffda5a47-85aa-4269-8332-c1ce3db64d4f req-834c2901-f5f2-45e4-b7b7-4073058422c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53262aa-7cf3-44ef-a688-cac5131e08bb", "name": "network-vif-unplugged", "status": "completed", "tag": "65f8231e-4b5e-4ec6-805b-a7feee02eab0"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:11.443894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ffda5a47-85aa-4269-8332-c1ce3db64d4f req-834c2901-f5f2-45e4-b7b7-4073058422c8 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:11.444337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-ffda5a47-85aa-4269-8332-c1ce3db64d4f req-834c2901-f5f2-45e4-b7b7-4073058422c8 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:11.454991 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.compute.server_external_events [req-ffda5a47-85aa-4269-8332-c1ce3db64d4f req-834c2901-f5f2-45e4-b7b7-4073058422c8 service nova] Unable to find a host for instance b53262aa-7cf3-44ef-a688-cac5131e08bb. Dropping event network-vif-unplugged {{(pid=118092) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 12:29:11.456444 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-ffda5a47-85aa-4269-8332-c1ce3db64d4f req-834c2901-f5f2-45e4-b7b7-4073058422c8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024196 Jun 20 12:29:11.456994 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 404/808] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 20 12:29:12.110533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:12.111250 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:12.118638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:12.119092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:12.119859 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:12.120294 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:12.254299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:12.262153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8d05fc6e-1ed9-4894-97cb-86a943ecf9a3 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1517 microversion: 2.1 time: 0.155439 Jun 20 12:29:12.262737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 405/809] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:12 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:12.267235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:12.267838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:12.273420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:12.273890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:12.274656 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:12.275094 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:12.405294 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:12.413738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-66dead5c-d40b-489a-bb76-eec3fd6c3e12 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1689 microversion: 2.1 time: 0.149790 Jun 20 12:29:12.414308 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 406/810] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:12 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:12.424257 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:12.425618 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:12.431573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:12.432040 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:12.432802 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:12.433232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:12.560489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:12.568081 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-af06dff1-585c-4e0e-9f6d-c0a85ee5ab22 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.147580 Jun 20 12:29:12.568653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 407/811] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:12 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:13.191751 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:13.279974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:13.280688 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:13.289649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.290134 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.290911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.291353 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.516462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:13.524690 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a0f50df3-536c-42d0-bd8f-215af2a9d56b tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1517 microversion: 2.1 time: 0.248680 Jun 20 12:29:13.525263 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 408/812] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:13 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:13.529854 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:13.530456 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:13.536880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.537331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.538151 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.538889 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.761491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:13.769988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-844d2d5b-6394-4d1c-bdb6-a1bb296ae2ce tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1689 microversion: 2.1 time: 0.243579 Jun 20 12:29:13.770867 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 409/813] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:13 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:13.775843 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:13.776524 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:13.782644 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.783191 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.785231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:13.785754 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:13.871444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b601e0d8-cf55-465b-8d43-1df43bc59083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "POST /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.843922 Jun 20 12:29:13.872076 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 405/814] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:29:10 2022] POST /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments => generated 194 bytes in 3846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:13.965340 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:13.972963 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9fcb40f3-8ac1-4ebc-b082-190d4421e57e tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1367 microversion: 2.1 time: 0.200948 Jun 20 12:29:13.973563 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 410/815] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:13 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:14.350991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-b796143d-c297-405f-9276-e2c84c3d681d req-0d2baacc-24b4-4398-8fca-5de5f7d06559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4", "name": "network-vif-deleted", "tag": "dfa767d1-2961-4d8b-8953-7eb7df3db7da"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:14.361372 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-b796143d-c297-405f-9276-e2c84c3d681d req-0d2baacc-24b4-4398-8fca-5de5f7d06559 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:14.363798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-b796143d-c297-405f-9276-e2c84c3d681d req-0d2baacc-24b4-4398-8fca-5de5f7d06559 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:14.376155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-b796143d-c297-405f-9276-e2c84c3d681d req-0d2baacc-24b4-4398-8fca-5de5f7d06559 service nova] Creating event network-vif-deleted:dfa767d1-2961-4d8b-8953-7eb7df3db7da for instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 on hv-cinder-83697 Jun 20 12:29:14.382838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-b796143d-c297-405f-9276-e2c84c3d681d req-0d2baacc-24b4-4398-8fca-5de5f7d06559 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037248 Jun 20 12:29:14.383445 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 406/816] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:14.542658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:14.543270 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:14.551412 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:14.551869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:14.552658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:14.553096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:14.701606 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:14.709714 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9b944239-c37f-45de-bf03-54129f7ba5f9 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1519 microversion: 2.1 time: 0.171375 Jun 20 12:29:14.710317 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 411/817] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:14 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:14.788020 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:14.789215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:14.796438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:14.796972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:14.797871 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:14.798393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:14.879957 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:14.887824 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-217f4115-31a4-40ac-936a-2d7145663a15 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 200 len: 1330 microversion: 2.1 time: 0.104291 Jun 20 12:29:14.888391 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 407/818] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:14 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:14.999182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:14.999792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:15.007375 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.011106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.011106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.011106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.145145 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:15.153219 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c53cde30-1156-47ef-9a9b-54e020687b6b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1556 microversion: 2.1 time: 0.166985 Jun 20 12:29:15.153829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 412/819] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:14 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:15.173990 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b0d3fbf8-74cd-41e7-b2c9-74f7c9b85057 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:15.174527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b0d3fbf8-74cd-41e7-b2c9-74f7c9b85057 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:15.193818 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b0d3fbf8-74cd-41e7-b2c9-74f7c9b85057 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.194650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b0d3fbf8-74cd-41e7-b2c9-74f7c9b85057 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.199038 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b0d3fbf8-74cd-41e7-b2c9-74f7c9b85057 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.199800 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b0d3fbf8-74cd-41e7-b2c9-74f7c9b85057 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.299227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b0d3fbf8-74cd-41e7-b2c9-74f7c9b85057 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129560 Jun 20 12:29:15.300034 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 408/820] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 20 12:29:15 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:15.727833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:15.728374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:15.735335 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.738015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.738015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.738015 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.905344 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:15.906054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:15.916384 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.920848 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.920848 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:15.920848 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:15.932983 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] HTTP exception thrown: Instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 could not be found. Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Request method failure captured: Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 HTTP/1.1 Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGasLiox8v87mMMuwvB5sZLcpwnf36uVrAHw--DgUS8DCscm1DRQBuIFjvtXKdxnBr75BzdkY482ZHjnhHiobtA8rsvW9-z5k8IPw23hqm5Wh1-h4YBXq5kxbtrCEQmRsxIjJtXX1ahdUgulZfrYKcQ53zxnssFmkP-XIfdpo9hhlD4 Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:15.934674 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}] Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: ec4c5293e6a148a2a16ba4c3fc57a3a3 Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 could not be found. Jun 20 12:29:15.936084 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4'} Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 could not be found. Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:15.936877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 could not be found. Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 could not be found. Jun 20 12:29:15.938241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:15.939367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Returning 404 to user: Instance f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:15.939367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ecd71878-e27f-4f8b-be60-402f64d226d0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4" status: 404 len: 111 microversion: 2.1 time: 0.035394 Jun 20 12:29:15.939367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 409/821] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:15 2022] GET /compute/v2.1/servers/f7a55f3b-2d6d-4f34-8caf-ec4f2b5924b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:15.945826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a362cd16-3fb6-4d1c-84c3-da51f442318f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '.version_select at 0x7fe283fa6430>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:16.016455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a362cd16-3fb6-4d1c-84c3-da51f442318f tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504275162" status: 202 len: 0 microversion: 2.1 time: 0.074291 Jun 20 12:29:16.017591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 410/822] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 20 12:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504275162 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:29:16.266235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:16.292455 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1895f16d-50bd-43d6-a93c-ce8406a1e327 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.565851 Jun 20 12:29:16.292455 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 413/823] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:15 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:17.310635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:17.311236 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:17.319904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:17.320228 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:17.320978 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:17.321422 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:17.353436 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-4bf7bb18-7e90-4fdb-962a-f253ab568e6b req-ad3b9c9d-80a5-4b94-9ab4-21c8a4241b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52dbe69-b2da-4efe-a1ee-2559900a2632", "tag": "8d767632-02a0-41c1-b527-257611deb664"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:17.366185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-4bf7bb18-7e90-4fdb-962a-f253ab568e6b req-ad3b9c9d-80a5-4b94-9ab4-21c8a4241b61 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:17.366623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-4bf7bb18-7e90-4fdb-962a-f253ab568e6b req-ad3b9c9d-80a5-4b94-9ab4-21c8a4241b61 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:17.380457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-4bf7bb18-7e90-4fdb-962a-f253ab568e6b req-ad3b9c9d-80a5-4b94-9ab4-21c8a4241b61 service nova] Creating event network-changed:8d767632-02a0-41c1-b527-257611deb664 for instance a52dbe69-b2da-4efe-a1ee-2559900a2632 on hv-cinder-83697 Jun 20 12:29:17.386521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-4bf7bb18-7e90-4fdb-962a-f253ab568e6b req-ad3b9c9d-80a5-4b94-9ab4-21c8a4241b61 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038113 Jun 20 12:29:17.387414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 414/824] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:17.471878 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:17.480620 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-836725ee-9e3c-42ee-99d3-9aa0527c2e59 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.177132 Jun 20 12:29:17.481197 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 411/825] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:17 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:18.498361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:18.499110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:18.506446 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:18.506828 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:18.507581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:18.508006 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:18.890263 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:18.897977 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bfc2bb44-28b3-4b95-a576-7e0cd55e98c8 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.403871 Jun 20 12:29:18.898534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 415/826] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:18 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:19.915184 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:19.915839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:19.922544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:19.922994 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:19.923759 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:19.924197 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.057401 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:20.064868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8357fdc1-03c7-44eb-982c-c60001a97baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.153872 Jun 20 12:29:20.066059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 412/827] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:19 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:20.235299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:20.235796 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:20.242938 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.245058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.245058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.245058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.272439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:29:20.620208 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-34f9a5a2-864b-40d8-85ee-ca817ea81e6b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 204 len: 0 microversion: 2.1 time: 0.388806 Jun 20 12:29:20.620801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 416/828] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:20 2022] DELETE /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:29:20.629246 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:20.629918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:20.635982 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.636432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.637202 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:20.637643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:20.770918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:20.778468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f19064ed-353f-4a46-94c1-ec3bcd69bba1 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1507 microversion: 2.1 time: 0.153413 Jun 20 12:29:20.779332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 413/829] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:20 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:21.084149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:21.084848 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:21.090960 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:21.091409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:21.092176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:21.092613 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:21.222424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:21.229957 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-80909d18-28a1-45c9-8423-ec0634ff8baf tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.150682 Jun 20 12:29:21.230529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 417/830] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:21 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:21.797381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:21.798028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:21.805354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:21.805821 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:21.806642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:21.807086 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:21.938403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:21.946046 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ce1dccd7-e50b-4cd5-a1bc-e18c0d37a2f2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1507 microversion: 2.1 time: 0.152849 Jun 20 12:29:21.946614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 414/831] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:21 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:22.247342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:22.247966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:22.255149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:22.255600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:22.256380 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:22.256813 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:22.396726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:22.404844 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-91a35402-8059-47bb-8142-7fe0e9676d36 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.161567 Jun 20 12:29:22.405410 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 418/832] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:22 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:22.963684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:22.964310 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:22.970933 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:22.971387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:22.972562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:22.973006 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.106385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:23.114627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-29e1068a-c70e-40f5-97a6-3bc97376b33b tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1507 microversion: 2.1 time: 0.154905 Jun 20 12:29:23.115194 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 415/833] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:22 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:23.422722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:23.423331 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:23.430242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:23.430696 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.431581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:23.432023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:23.436550 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:23.574327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:23.583013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-961f5823-b4dd-4eef-b29e-a7d5cf19645f tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.164126 Jun 20 12:29:23.583588 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 419/834] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:23 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:24.120043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-6254784e-0b02-4b76-a9ee-3517ff7938bc req-47907daf-6885-421c-84d9-ccedd690d406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce80a92-cf20-4b98-9d4e-3d8dd0d42d54", "name": "network-vif-deleted", "tag": "d5ebea9e-5c66-4f1f-93e8-d61c4bb9fe29"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:24.130600 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-6254784e-0b02-4b76-a9ee-3517ff7938bc req-47907daf-6885-421c-84d9-ccedd690d406 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.131338 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-6254784e-0b02-4b76-a9ee-3517ff7938bc req-47907daf-6885-421c-84d9-ccedd690d406 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.132903 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:24.133513 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:24.139669 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.140116 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.140886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.141314 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.155685 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-6254784e-0b02-4b76-a9ee-3517ff7938bc req-47907daf-6885-421c-84d9-ccedd690d406 service nova] Creating event network-vif-deleted:d5ebea9e-5c66-4f1f-93e8-d61c4bb9fe29 for instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 on hv-cinder-83697 Jun 20 12:29:24.168344 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-6254784e-0b02-4b76-a9ee-3517ff7938bc req-47907daf-6885-421c-84d9-ccedd690d406 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055884 Jun 20 12:29:24.169033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 416/835] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:24.208097 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:24.216699 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e04cd168-dc47-42e3-bfb7-c5b06fedb6f0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 200 len: 1465 microversion: 2.1 time: 0.088563 Jun 20 12:29:24.217307 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 420/836] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:24 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 1465 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:24.578575 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4c312340-53a2-47f1-8d4d-a1fbc5447cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:24.579811 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4c312340-53a2-47f1-8d4d-a1fbc5447cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:24.586633 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4c312340-53a2-47f1-8d4d-a1fbc5447cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.587088 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4c312340-53a2-47f1-8d4d-a1fbc5447cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.587897 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4c312340-53a2-47f1-8d4d-a1fbc5447cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.588343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4c312340-53a2-47f1-8d4d-a1fbc5447cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.600874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:24.601668 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:24.608215 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.608786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.609643 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.610169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.619590 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4c312340-53a2-47f1-8d4d-a1fbc5447cda tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045527 Jun 20 12:29:24.620150 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 417/837] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:24 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:24.744179 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:24.751724 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9f7c74c0-367a-43e9-aa44-05b205434e00 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.155596 Jun 20 12:29:24.752289 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 421/838] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:24 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:24.763983 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ee48a69a-484b-4726-9362-0773f1273224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:24.764472 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ee48a69a-484b-4726-9362-0773f1273224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:24.771542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee48a69a-484b-4726-9362-0773f1273224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.771990 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee48a69a-484b-4726-9362-0773f1273224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.772752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee48a69a-484b-4726-9362-0773f1273224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.773185 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ee48a69a-484b-4726-9362-0773f1273224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.803157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ee48a69a-484b-4726-9362-0773f1273224 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/7dfb70f0-9a3b-4db5-8a39-a827db92b2d0" status: 200 len: 194 microversion: 2.1 time: 0.043108 Jun 20 12:29:24.803752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 418/839] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jun 20 12:29:24 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/7dfb70f0-9a3b-4db5-8a39-a827db92b2d0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:24.813322 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:24.813829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:24.819957 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.820405 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.821169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:24.821611 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:24.905299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lazy-loading 'services' on Instance uuid 74a19367-11da-40fa-b0e3-26d50b960479 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:25.185771 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2e9ab903-8497-40c1-ad20-63e213c3da92 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/7dfb70f0-9a3b-4db5-8a39-a827db92b2d0" status: 202 len: 0 microversion: 2.1 time: 0.376212 Jun 20 12:29:25.186501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 422/840] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:29:24 2022] DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/7dfb70f0-9a3b-4db5-8a39-a827db92b2d0 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:25.234388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:25.235087 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: dce80a92-cf20-4b98-9d4e-3d8dd0d42d54] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:25.242081 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.242531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.243311 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.243750 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.258282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] HTTP exception thrown: Instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 could not be found. Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Request method failure captured: Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 HTTP/1.1 Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGasLiox8v87mMMuwvB5sZLcpwnf36uVrAHw--DgUS8DCscm1DRQBuIFjvtXKdxnBr75BzdkY482ZHjnhHiobtA8rsvW9-z5k8IPw23hqm5Wh1-h4YBXq5kxbtrCEQmRsxIjJtXX1ahdUgulZfrYKcQ53zxnssFmkP-XIfdpo9hhlD4 Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:25.260162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}] Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: ec4c5293e6a148a2a16ba4c3fc57a3a3 Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 could not be found. Jun 20 12:29:25.262036 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'dce80a92-cf20-4b98-9d4e-3d8dd0d42d54'} Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 could not be found. Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:25.265999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 could not be found. Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 could not be found. Jun 20 12:29:25.267512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:25.270162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Returning 404 to user: Instance dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:25.270162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7abfe32e-ef6a-464b-818a-4403223c3a16 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54" status: 404 len: 111 microversion: 2.1 time: 0.031596 Jun 20 12:29:25.270162 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 419/841] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:25 2022] GET /compute/v2.1/servers/dce80a92-cf20-4b98-9d4e-3d8dd0d42d54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:25.275764 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:25.276297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:25.282815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.283263 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.284064 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.284494 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.311635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:29:25.638304 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-da0c7d00-9514-42ab-ba23-ae8ba8bdca4a tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "DELETE /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 204 len: 0 microversion: 2.1 time: 0.366461 Jun 20 12:29:25.638994 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 423/842] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:25 2022] DELETE /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:29:25.647304 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:25.647928 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:25.653898 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.654356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.655128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.655568 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.769283 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:25.770106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:25.776913 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.777702 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.778813 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:25.779658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:25.794310 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:25.804641 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-56d42d9f-896c-4363-b4b0-eacebf6fc065 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.161284 Jun 20 12:29:25.811215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 420/843] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:25 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:25.928389 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:25.936233 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-be795ea5-e23e-4a32-8369-d5b94525ea70 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.171521 Jun 20 12:29:25.936805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 424/844] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:25 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:26.826666 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:26.827271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:26.834313 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.834754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.835514 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.835951 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.952354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:26.952964 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:26.955364 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:26.961236 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.961679 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.962489 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:26.962916 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:26.967517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:26.976132 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4f58b1d0-38bf-4261-b8e8-aa8c67f255b0 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.153353 Jun 20 12:29:26.976709 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 421/845] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:26 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:27.099041 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:27.106749 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e00525ce-341f-47be-ad77-1dbba39b0cab tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.158175 Jun 20 12:29:27.107330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 425/846] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:26 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:27.193267 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-f4963b33-d1e9-46f8-9e9a-fecb86cc2620 req-c1acb4c3-1f92-4622-b81e-edfa4dbe9f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53262aa-7cf3-44ef-a688-cac5131e08bb", "name": "network-vif-plugged", "status": "completed", "tag": "65f8231e-4b5e-4ec6-805b-a7feee02eab0"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:27.201684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f4963b33-d1e9-46f8-9e9a-fecb86cc2620 req-c1acb4c3-1f92-4622-b81e-edfa4dbe9f8a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:27.202160 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f4963b33-d1e9-46f8-9e9a-fecb86cc2620 req-c1acb4c3-1f92-4622-b81e-edfa4dbe9f8a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:27.212998 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-f4963b33-d1e9-46f8-9e9a-fecb86cc2620 req-c1acb4c3-1f92-4622-b81e-edfa4dbe9f8a service nova] Creating event network-vif-plugged:65f8231e-4b5e-4ec6-805b-a7feee02eab0 for instance b53262aa-7cf3-44ef-a688-cac5131e08bb on hv-cinder-83697 Jun 20 12:29:27.217763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-f4963b33-d1e9-46f8-9e9a-fecb86cc2620 req-c1acb4c3-1f92-4622-b81e-edfa4dbe9f8a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029034 Jun 20 12:29:27.218360 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 422/847] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:27.550522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-534575529"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:27.551160 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:27.557160 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:27.557603 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:27.558400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:27.558833 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:27.688793 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.network.security_group_api [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Removing security group 227009d6-3caa-465a-b81e-5b3466a5a9a0 from port aeb492a1-b6de-465b-b91f-a1ad04692797 Jun 20 12:29:27.994294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:27.995022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:28.001243 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.001691 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:28.002495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.002998 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:28.153491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c47185a2-ae75-44b5-9ed9-dd3ba65e95ee tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/action" status: 202 len: 0 microversion: 2.1 time: 0.607543 Jun 20 12:29:28.157209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 426/848] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 20 12:29:27 2022] POST /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:28.179768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:28.180400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:28.190915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.190915 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:28.192807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.193484 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:28.295707 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:28.310195 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d3b70210-b1da-4778-beba-771deff24317 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.320493 Jun 20 12:29:28.311734 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 423/849] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:27 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:28.319461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-00f7cb45-969e-4bc1-985a-73e3227c6d2c req-c6bc57b8-32cf-4da9-bf74-dbf3772c980e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50771-1643-4ddb-9375-6e52b0789270", "tag": "aeb492a1-b6de-465b-b91f-a1ad04692797"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:28.338225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-00f7cb45-969e-4bc1-985a-73e3227c6d2c req-c6bc57b8-32cf-4da9-bf74-dbf3772c980e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:28.339029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-00f7cb45-969e-4bc1-985a-73e3227c6d2c req-c6bc57b8-32cf-4da9-bf74-dbf3772c980e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:28.354644 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-00f7cb45-969e-4bc1-985a-73e3227c6d2c req-c6bc57b8-32cf-4da9-bf74-dbf3772c980e service nova] Creating event network-changed:aeb492a1-b6de-465b-b91f-a1ad04692797 for instance 99c50771-1643-4ddb-9375-6e52b0789270 on hv-cinder-83697 Jun 20 12:29:28.361301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-00f7cb45-969e-4bc1-985a-73e3227c6d2c req-c6bc57b8-32cf-4da9-bf74-dbf3772c980e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047697 Jun 20 12:29:28.365722 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 424/850] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:28.467477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:28.479446 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-af14e479-8ebc-4b4c-9cef-c8a66b94253d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.320777 Jun 20 12:29:28.481894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 427/851] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:28 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:29.329318 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:29.330669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:29.337688 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.338277 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.338999 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.339443 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.477460 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:29.486349 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-76c2bfdf-09b7-4b00-9f5b-10f9c5a04d70 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1521 microversion: 2.1 time: 0.161939 Jun 20 12:29:29.488302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 425/852] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:29 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:29.498825 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:29.499590 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:29.522501 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9cc1c171-3a80-4a7e-8e92-51b217d6adf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:29.524715 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.525169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.525974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.526412 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.532198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9cc1c171-3a80-4a7e-8e92-51b217d6adf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:29.541888 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc1c171-3a80-4a7e-8e92-51b217d6adf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.545493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc1c171-3a80-4a7e-8e92-51b217d6adf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.545493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc1c171-3a80-4a7e-8e92-51b217d6adf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.545493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc1c171-3a80-4a7e-8e92-51b217d6adf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.573035 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:29.577104 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9cc1c171-3a80-4a7e-8e92-51b217d6adf9 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/8033f742-ca08-438e-a2b0-e91e7f338202" status: 200 len: 194 microversion: 2.1 time: 0.062384 Jun 20 12:29:29.577683 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 426/853] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jun 20 12:29:29 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/8033f742-ca08-438e-a2b0-e91e7f338202 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:29.587592 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:29.588096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:29.594422 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.594878 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.595681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:29.596126 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:29.696256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lazy-loading 'services' on Instance uuid 74a19367-11da-40fa-b0e3-26d50b960479 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:29.843093 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:29.851554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5452093b-e0a6-4381-a1a0-339098bc1640 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1575 microversion: 2.1 time: 0.356633 Jun 20 12:29:29.852140 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 428/854] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:29 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1575 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:29.939277 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2714ad62-f64e-44e5-a509-1a6896003c7c tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/8033f742-ca08-438e-a2b0-e91e7f338202" status: 202 len: 0 microversion: 2.1 time: 0.355249 Jun 20 12:29:29.941300 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 427/855] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:29:29 2022] DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments/8033f742-ca08-438e-a2b0-e91e7f338202 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:29:30.470177 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-7580082c-7cf4-4a6c-af5a-6cb4c19530f7 req-f8d690ed-248d-4f36-ab4c-b8b3ed8ed551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108e8e51-7234-4ddc-9ff6-6e2bfed530ff", "name": "network-vif-deleted", "tag": "ec887b68-8427-4b8e-94d0-cd7c4c5dd881"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:30.479619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-7580082c-7cf4-4a6c-af5a-6cb4c19530f7 req-f8d690ed-248d-4f36-ab4c-b8b3ed8ed551 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.480063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-7580082c-7cf4-4a6c-af5a-6cb4c19530f7 req-f8d690ed-248d-4f36-ab4c-b8b3ed8ed551 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.485099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:30.485781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:30.492645 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-7580082c-7cf4-4a6c-af5a-6cb4c19530f7 req-f8d690ed-248d-4f36-ab4c-b8b3ed8ed551 service nova] Creating event network-vif-deleted:ec887b68-8427-4b8e-94d0-cd7c4c5dd881 for instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff on hv-cinder-83697 Jun 20 12:29:30.494523 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.495072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.495944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.496485 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.497855 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-7580082c-7cf4-4a6c-af5a-6cb4c19530f7 req-f8d690ed-248d-4f36-ab4c-b8b3ed8ed551 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 Jun 20 12:29:30.498765 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 429/856] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:30.506850 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:30.508827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:30.515992 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.516698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.517656 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.519503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.563059 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.565739 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.565739 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lazy-loading 'fault' on Instance uuid 108e8e51-7234-4ddc-9ff6-6e2bfed530ff {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:30.588091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lazy-loading 'services' on Instance uuid 99c50771-1643-4ddb-9375-6e52b0789270 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:30.611574 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4c5293e6a148a2a16ba4c3fc57a3a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:30.622182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c3cb17e3-954d-413c-a09d-2c911c9cbb31 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 200 len: 1312 microversion: 2.1 time: 0.121189 Jun 20 12:29:30.622761 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 430/857] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:30 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:30.792542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1f8ffabb-7394-4d5c-961b-a19e73bd7192 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "DELETE /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments/c30f11fa-d24b-41f7-bf2f-dc321e0ae295" status: 202 len: 0 microversion: 2.1 time: 0.311503 Jun 20 12:29:30.793447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 428/858] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:29:30 2022] DELETE /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments/c30f11fa-d24b-41f7-bf2f-dc321e0ae295 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:30.803861 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d2c6cf65-7403-40dd-956f-13ab3d65bb41 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:30.807451 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d2c6cf65-7403-40dd-956f-13ab3d65bb41 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:30.813598 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf65-7403-40dd-956f-13ab3d65bb41 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.814286 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf65-7403-40dd-956f-13ab3d65bb41 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.816069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf65-7403-40dd-956f-13ab3d65bb41 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.816733 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d2c6cf65-7403-40dd-956f-13ab3d65bb41 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.870646 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:30.871532 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:30.879655 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.880510 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:30.881703 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:30.882276 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:31.008829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d2c6cf65-7403-40dd-956f-13ab3d65bb41 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210078 Jun 20 12:29:31.009696 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 431/859] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:30 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:31.060880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:31.083899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-15a71c52-8b43-41a6-8f2a-f1840169d60e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1562 microversion: 2.1 time: 0.217282 Jun 20 12:29:31.096058 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 429/860] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:30 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:31.640100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:31.640740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] [instance: 108e8e51-7234-4ddc-9ff6-6e2bfed530ff] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:31.647606 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:31.648055 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:31.648830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:31.649262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:31.663437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] HTTP exception thrown: Instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff could not be found. Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Request method failure captured: Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff HTTP/1.1 Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasLiox8v87mMMuwvB5sZLcpwnf36uVrAHw--DgUS8DCscm1DRQBuIFjvtXKdxnBr75BzdkY482ZHjnhHiobtA8rsvW9-z5k8IPw23hqm5Wh1-h4YBXq5kxbtrCEQmRsxIjJtXX1ahdUgulZfrYKcQ53zxnssFmkP-XIfdpo9hhlD4 Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:31.665409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d55e2a4f35944f65bb0d5b1382b8cafc"}]}] Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: d55e2a4f35944f65bb0d5b1382b8cafc Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1196000093 Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: ec4c5293e6a148a2a16ba4c3fc57a3a3 Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1196000093-project Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff could not be found. Jun 20 12:29:31.667053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '108e8e51-7234-4ddc-9ff6-6e2bfed530ff'} Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff could not be found. Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:31.667870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff could not be found. Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff could not be found. Jun 20 12:29:31.669205 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:31.670354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] Returning 404 to user: Instance 108e8e51-7234-4ddc-9ff6-6e2bfed530ff could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:31.670354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-530f164d-66f7-47dc-a4ad-3906776bc6a2 tempest-ServerRescueNegativeTestJSON-1196000093 tempest-ServerRescueNegativeTestJSON-1196000093-project] 10.222.0.64 "GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff" status: 404 len: 111 microversion: 2.1 time: 0.030614 Jun 20 12:29:31.670354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 432/861] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:31 2022] GET /compute/v2.1/servers/108e8e51-7234-4ddc-9ff6-6e2bfed530ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:32.021591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-713c6777-abf5-4725-9b79-3309f7d3a396 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:32.022644 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-713c6777-abf5-4725-9b79-3309f7d3a396 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:32.032153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-713c6777-abf5-4725-9b79-3309f7d3a396 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.032607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-713c6777-abf5-4725-9b79-3309f7d3a396 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.033391 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-713c6777-abf5-4725-9b79-3309f7d3a396 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.033865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-713c6777-abf5-4725-9b79-3309f7d3a396 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.069186 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-713c6777-abf5-4725-9b79-3309f7d3a396 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052549 Jun 20 12:29:32.073280 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 430/862] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:32 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:32.256737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-308c260d-1967-4354-b9c7-88f93b181e76 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:32.257765 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-308c260d-1967-4354-b9c7-88f93b181e76 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:32.264383 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-308c260d-1967-4354-b9c7-88f93b181e76 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.265639 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-308c260d-1967-4354-b9c7-88f93b181e76 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.265758 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-308c260d-1967-4354-b9c7-88f93b181e76 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.266151 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-308c260d-1967-4354-b9c7-88f93b181e76 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.297407 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-308c260d-1967-4354-b9c7-88f93b181e76 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044619 Jun 20 12:29:32.297981 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 433/863] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:32 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:29:32.407681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3fd4f9e1-8ca1-4bfe-ae50-410bb8f418a3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:32.408669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3fd4f9e1-8ca1-4bfe-ae50-410bb8f418a3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:32.415713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fd4f9e1-8ca1-4bfe-ae50-410bb8f418a3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.416407 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fd4f9e1-8ca1-4bfe-ae50-410bb8f418a3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.417205 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fd4f9e1-8ca1-4bfe-ae50-410bb8f418a3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.417641 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3fd4f9e1-8ca1-4bfe-ae50-410bb8f418a3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.447618 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3fd4f9e1-8ca1-4bfe-ae50-410bb8f418a3 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043813 Jun 20 12:29:32.448173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 431/864] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:32 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:29:32.514535 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-2504db71-b4db-4596-b230-6b04bf9071c0 req-679c4b5b-9a0a-4c60-887b-295dc2ff808a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50771-1643-4ddb-9375-6e52b0789270", "tag": "aeb492a1-b6de-465b-b91f-a1ad04692797"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:32.516888 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:32.517392 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:32.524070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.524237 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2504db71-b4db-4596-b230-6b04bf9071c0 req-679c4b5b-9a0a-4c60-887b-295dc2ff808a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.524521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.524891 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2504db71-b4db-4596-b230-6b04bf9071c0 req-679c4b5b-9a0a-4c60-887b-295dc2ff808a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.525301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.525739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.537971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-2504db71-b4db-4596-b230-6b04bf9071c0 req-679c4b5b-9a0a-4c60-887b-295dc2ff808a service nova] Creating event network-changed:aeb492a1-b6de-465b-b91f-a1ad04692797 for instance 99c50771-1643-4ddb-9375-6e52b0789270 on hv-cinder-83697 Jun 20 12:29:32.543575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-2504db71-b4db-4596-b230-6b04bf9071c0 req-679c4b5b-9a0a-4c60-887b-295dc2ff808a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032882 Jun 20 12:29:32.544455 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 434/865] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:32.553254 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:29:32.935944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3623920b-ecfd-40e5-b24f-211ff106ede4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 204 len: 0 microversion: 2.1 time: 0.422482 Jun 20 12:29:32.936853 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 432/866] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:32 2022] DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:29:32.947608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:32.948444 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:32.954805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.955394 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.959386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:32.959386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:32.979922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:33.091988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2875fc6a-d18e-4177-83d9-92b42b51b64e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:33.093705 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2875fc6a-d18e-4177-83d9-92b42b51b64e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:33.104689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2875fc6a-d18e-4177-83d9-92b42b51b64e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.105333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2875fc6a-d18e-4177-83d9-92b42b51b64e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.107203 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2875fc6a-d18e-4177-83d9-92b42b51b64e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.108091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2875fc6a-d18e-4177-83d9-92b42b51b64e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.116198 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:33.127417 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f6fa15d6-db1a-40f9-a050-7abd4a51a54b tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1670 microversion: 2.1 time: 0.184624 Jun 20 12:29:33.130190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 435/867] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:32 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:33.147971 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2875fc6a-d18e-4177-83d9-92b42b51b64e tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069599 Jun 20 12:29:33.148694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 433/868] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:29:33 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:29:33.160236 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:33.164292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:33.167290 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.167747 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.168790 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:33.169236 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:33.252137 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] HTTP exception thrown: Instance 99c50771-1643-4ddb-9375-6e52b0789270 is not attached to volume c30f11fa-d24b-41f7-bf2f-dc321e0ae295 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Request method failure captured: Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments/c30f11fa-d24b-41f7-bf2f-dc321e0ae295 HTTP/1.1 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGd72WdLJKi9LPC7qFmCkLtIrYJ7VuqA3Jf2B6W_YL193efeeOO_sqpEx61SAL3zrBFVcY5G-TjqDtIdQDxoPE_YUA2s9u1PkMJjn5tDhf3DyvG5akXZguhPDhO3Q8fLb4ohXENPX9aPWLtPveGfXlQWbSjn6eWOwiY6vpR4Kuc-N00 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 7a033c0ad5484ff89949482c587ea5e7 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-TestMinimumBasicScenario-1963011242 Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:33.254830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7a033c0ad5484ff89949482c587ea5e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7a033c0ad5484ff89949482c587ea5e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7a033c0ad5484ff89949482c587ea5e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7a033c0ad5484ff89949482c587ea5e7"}]}] Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-TestMinimumBasicScenario-1963011242 Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 7a033c0ad5484ff89949482c587ea5e7 Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1963011242 Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-TestMinimumBasicScenario-1963011242-project Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 4c0fe72487114f47ad7944b05d3698b1 Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-TestMinimumBasicScenario-1963011242-project Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:29:33.256271 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 99c50771-1643-4ddb-9375-6e52b0789270 is not attached to volume c30f11fa-d24b-41f7-bf2f-dc321e0ae295 Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'server_id': '99c50771-1643-4ddb-9375-6e52b0789270', 'id': 'c30f11fa-d24b-41f7-bf2f-dc321e0ae295'} Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c30f11fa-d24b-41f7-bf2f-dc321e0ae295. Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:33.256986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c50771-1643-4ddb-9375-6e52b0789270 is not attached to volume c30f11fa-d24b-41f7-bf2f-dc321e0ae295 Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c50771-1643-4ddb-9375-6e52b0789270 is not attached to volume c30f11fa-d24b-41f7-bf2f-dc321e0ae295 Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:33.258272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Returning 404 to user: Instance 99c50771-1643-4ddb-9375-6e52b0789270 is not attached to volume c30f11fa-d24b-41f7-bf2f-dc321e0ae295 {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:33.259211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e2777bf8-bee4-46aa-948d-75cb8158e5c2 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "DELETE /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments/c30f11fa-d24b-41f7-bf2f-dc321e0ae295" status: 404 len: 154 microversion: 2.1 time: 0.100643 Jun 20 12:29:33.259211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 436/869] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:29:33 2022] DELETE /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270/os-volume_attachments/c30f11fa-d24b-41f7-bf2f-dc321e0ae295 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:29:34.147551 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:34.148163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:34.154891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:34.155347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:34.161657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:34.161657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:34.498770 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:34.510966 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7fbf4a6d-1ab3-4448-bff7-780e081c4a12 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1670 microversion: 2.1 time: 0.368014 Jun 20 12:29:34.511554 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 434/870] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:34 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1670 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:34.555552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:34.556117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:34.562806 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:34.563313 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:34.567853 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:34.567853 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:34.592433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:29:35.084318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-39b87971-df86-4b35-86f5-af5fa6cad1e5 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "DELETE /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 204 len: 0 microversion: 2.1 time: 0.532597 Jun 20 12:29:35.084829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 437/871] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:34 2022] DELETE /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:29:35.096930 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:35.097883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:35.106152 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:35.106930 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.108096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:35.108761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.280157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:35.288576 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-19c9a093-4b8e-444e-b7aa-a4e6a4c42fc0 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1553 microversion: 2.1 time: 0.199245 Jun 20 12:29:35.299370 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 435/872] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:35 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:29:35.529654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:35.530386 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:35.537337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:35.540788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.540788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:35.540788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:35.894841 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:35.903416 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-31db3cd2-2762-43cd-b5c6-0d9e7ec19cfb tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1670 microversion: 2.1 time: 0.378013 Jun 20 12:29:35.904345 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 438/873] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:35 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1670 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:36.162319 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-c3c33df5-63e1-4eb3-a89a-1d085e0ef02a req-c5a881cf-f79f-43b1-ba10-953a8c2f1b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a19367-11da-40fa-b0e3-26d50b960479", "name": "network-vif-deleted", "tag": "ea11fe30-3cec-4a76-bdd2-db108d460048"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:36.173707 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-c3c33df5-63e1-4eb3-a89a-1d085e0ef02a req-c5a881cf-f79f-43b1-ba10-953a8c2f1b78 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.174176 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-c3c33df5-63e1-4eb3-a89a-1d085e0ef02a req-c5a881cf-f79f-43b1-ba10-953a8c2f1b78 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.187480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-c3c33df5-63e1-4eb3-a89a-1d085e0ef02a req-c5a881cf-f79f-43b1-ba10-953a8c2f1b78 service nova] Creating event network-vif-deleted:ea11fe30-3cec-4a76-bdd2-db108d460048 for instance 74a19367-11da-40fa-b0e3-26d50b960479 on hv-cinder-83697 Jun 20 12:29:36.194511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-c3c33df5-63e1-4eb3-a89a-1d085e0ef02a req-c5a881cf-f79f-43b1-ba10-953a8c2f1b78 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038036 Jun 20 12:29:36.195363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 436/874] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:36.307492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:36.308112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:36.314556 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.314945 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.315925 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.316367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.458142 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:36.466666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-eb3f6993-61ea-4449-b8c8-8e6ae023319a tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1553 microversion: 2.1 time: 0.163090 Jun 20 12:29:36.467227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 439/875] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:36 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:36.926481 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:36.931827 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:36.949207 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.959505 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:36.962451 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:36.963860 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.007717 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.008260 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.008925 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lazy-loading 'fault' on Instance uuid 74a19367-11da-40fa-b0e3-26d50b960479 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:37.062614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41eb98b3a8434e7e9734eb747047a87d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7566543a6145b7b1a01612aff1c02a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:37.071998 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-70e9568b-d20f-46d3-9cdb-0ff752838e33 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 200 len: 1324 microversion: 2.1 time: 0.154131 Jun 20 12:29:37.073326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 437/876] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:36 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 1324 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:37.491571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:37.496065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:37.509152 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.510110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.510443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:37.510884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:37.613071 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:37.620774 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-596416ae-ec23-46f7-802e-2ca84c6bcb65 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1511 microversion: 2.1 time: 0.138111 Jun 20 12:29:37.621383 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 440/877] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:37 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1511 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:38.095356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:38.096049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:38.102761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.103215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.103998 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.104444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.119817 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] HTTP exception thrown: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Request method failure captured: Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 HTTP/1.1 Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGam4vxCtgYiLajilu2IiHrrW6mcCPHnWc9lSua9nWV3V0Y9_fue2YCD562NAfDkiNdHy20HY99tEPU6vzYOeg7htwvm0-Q4Qes24Rcl5M-LJgJR-aj4W-BOP5y9TR9o2dM_knlW4I2n9RiPdWtO2ePJpJrkXrhVA50PQDoNAVwpT1c Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:38.121527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}] Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 41eb98b3a8434e7e9734eb747047a87d Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:38.123096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '74a19367-11da-40fa-b0e3-26d50b960479'} Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:38.124694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:38.135671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:38.136910 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Returning 404 to user: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:38.136910 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-16918eb2-3b57-489f-9ba5-7fac68959083 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 404 len: 111 microversion: 2.1 time: 0.033079 Jun 20 12:29:38.136910 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 438/878] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:38 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:29:38.137191 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d3a075a2-2fc4-42b9-8757-c4860a24ce66 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '.version_select at 0x7fe2908a88b0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:38.209471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-53f61ac3-1e86-4634-83a6-bc9683966f0c req-e3afd650-274e-476f-bf3a-688b57de8139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c50771-1643-4ddb-9375-6e52b0789270", "name": "network-vif-deleted", "tag": "aeb492a1-b6de-465b-b91f-a1ad04692797"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:38.217516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-53f61ac3-1e86-4634-83a6-bc9683966f0c req-e3afd650-274e-476f-bf3a-688b57de8139 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.218005 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-53f61ac3-1e86-4634-83a6-bc9683966f0c req-e3afd650-274e-476f-bf3a-688b57de8139 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.231752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-53f61ac3-1e86-4634-83a6-bc9683966f0c req-e3afd650-274e-476f-bf3a-688b57de8139 service nova] Creating event network-vif-deleted:aeb492a1-b6de-465b-b91f-a1ad04692797 for instance 99c50771-1643-4ddb-9375-6e52b0789270 on hv-cinder-83697 Jun 20 12:29:38.235628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d3a075a2-2fc4-42b9-8757-c4860a24ce66 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-693568" status: 202 len: 0 microversion: 2.1 time: 0.106733 Jun 20 12:29:38.236502 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 441/879] 10.222.0.64 () {58 vars in 1208 bytes} [Mon Jun 20 12:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-693568 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:38.236622 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-53f61ac3-1e86-4634-83a6-bc9683966f0c req-e3afd650-274e-476f-bf3a-688b57de8139 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030799 Jun 20 12:29:38.237144 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 439/880] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:38.639147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:38.639758 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:38.647333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.647846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.649225 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.649680 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.684103 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:38.684812 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:38.685473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lazy-loading 'fault' on Instance uuid 99c50771-1643-4ddb-9375-6e52b0789270 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:29:38.736981 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c0fe72487114f47ad7944b05d3698b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a033c0ad5484ff89949482c587ea5e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:38.746997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bea8a5a5-bb88-4a04-8a6c-fda1d6dcea11 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 200 len: 1347 microversion: 2.1 time: 0.111815 Jun 20 12:29:38.747790 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 442/881] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:38 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:29:39.767271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:39.767974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] [instance: 99c50771-1643-4ddb-9375-6e52b0789270] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:39.774789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.775238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.776061 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:39.776488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:39.791221 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] HTTP exception thrown: Instance 99c50771-1643-4ddb-9375-6e52b0789270 could not be found. Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Request method failure captured: Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 HTTP/1.1 Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGd72WdLJKi9LPC7qFmCkLtIrYJ7VuqA3Jf2B6W_YL193efeeOO_sqpEx61SAL3zrBFVcY5G-TjqDtIdQDxoPE_YUA2s9u1PkMJjn5tDhf3DyvG5akXZguhPDhO3Q8fLb4ohXENPX9aPWLtPveGfXlQWbSjn6eWOwiY6vpR4Kuc-N00 Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 7a033c0ad5484ff89949482c587ea5e7 Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-TestMinimumBasicScenario-1963011242 Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:39.792852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7a033c0ad5484ff89949482c587ea5e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7a033c0ad5484ff89949482c587ea5e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7a033c0ad5484ff89949482c587ea5e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7a033c0ad5484ff89949482c587ea5e7"}]}] Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-TestMinimumBasicScenario-1963011242 Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 7a033c0ad5484ff89949482c587ea5e7 Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1963011242 Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-TestMinimumBasicScenario-1963011242-project Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 4c0fe72487114f47ad7944b05d3698b1 Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-TestMinimumBasicScenario-1963011242-project Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 99c50771-1643-4ddb-9375-6e52b0789270 could not be found. Jun 20 12:29:39.794534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '99c50771-1643-4ddb-9375-6e52b0789270'} Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c50771-1643-4ddb-9375-6e52b0789270 could not be found. Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:39.795427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c50771-1643-4ddb-9375-6e52b0789270 could not be found. Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c50771-1643-4ddb-9375-6e52b0789270 could not be found. Jun 20 12:29:39.796672 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:39.797822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Returning 404 to user: Instance 99c50771-1643-4ddb-9375-6e52b0789270 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:39.797822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a62fe308-ef52-4121-9af6-4414b620f483 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270" status: 404 len: 111 microversion: 2.1 time: 0.031952 Jun 20 12:29:39.797822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 440/882] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:39 2022] GET /compute/v2.1/servers/99c50771-1643-4ddb-9375-6e52b0789270 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:29:39.803974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-84afb0f1-e37a-46e8-a96e-c6f940d4ca99 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] Calling method '.version_select at 0x7fe29088d160>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:39.955288 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-84afb0f1-e37a-46e8-a96e-c6f940d4ca99 tempest-TestMinimumBasicScenario-1963011242 tempest-TestMinimumBasicScenario-1963011242-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-774552932" status: 202 len: 0 microversion: 2.1 time: 0.155623 Jun 20 12:29:39.956824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 443/883] 10.222.0.64 () {58 vars in 1268 bytes} [Mon Jun 20 12:29:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-774552932 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:41.884531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:41.891173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:41.891173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:41.892728 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.893898 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.894738 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.895241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.910214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] HTTP exception thrown: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Request method failure captured: Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 HTTP/1.1 Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGam4vxCtgYiLajilu2IiHrrW6mcCPHnWc9lSua9nWV3V0Y9_fue2YCD562NAfDkiNdHy20HY99tEPU6vzYOeg7htwvm0-Q4Qes24Rcl5M-LJgJR-aj4W-BOP5y9TR9o2dM_knlW4I2n9RiPdWtO2ePJpJrkXrhVA50PQDoNAVwpT1c Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:41.912345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}] Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 41eb98b3a8434e7e9734eb747047a87d Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.914051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '74a19367-11da-40fa-b0e3-26d50b960479'} Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:41.915234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.916701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.920305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Returning 404 to user: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:41.920305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0dfee47c-7430-48bb-a551-03489bff38d7 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 404 len: 111 microversion: 2.1 time: 0.033040 Jun 20 12:29:41.920305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 441/884] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:41 2022] DELETE /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:41.924330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:41.925162 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: 74a19367-11da-40fa-b0e3-26d50b960479] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:41.932700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.933248 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.934189 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:41.934860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:41.950945 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] HTTP exception thrown: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Request method failure captured: Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 HTTP/1.1 Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGam4vxCtgYiLajilu2IiHrrW6mcCPHnWc9lSua9nWV3V0Y9_fue2YCD562NAfDkiNdHy20HY99tEPU6vzYOeg7htwvm0-Q4Qes24Rcl5M-LJgJR-aj4W-BOP5y9TR9o2dM_knlW4I2n9RiPdWtO2ePJpJrkXrhVA50PQDoNAVwpT1c Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:41.952777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}] Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 41eb98b3a8434e7e9734eb747047a87d Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.954311 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '74a19367-11da-40fa-b0e3-26d50b960479'} Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:41.955062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. Jun 20 12:29:41.957896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:41.959515 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Returning 404 to user: Instance 74a19367-11da-40fa-b0e3-26d50b960479 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:41.959515 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b172c7b8-7ae2-4023-81df-d19926bd9dab tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479" status: 404 len: 111 microversion: 2.1 time: 0.035073 Jun 20 12:29:41.959515 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 444/885] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:41 2022] GET /compute/v2.1/servers/74a19367-11da-40fa-b0e3-26d50b960479 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:43.323033 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:43.324353 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:43.337242 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.338153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.339017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.344814 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.377041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] HTTP exception thrown: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Request method failure captured: Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: DELETE /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 HTTP/1.1 Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGam4vxCtgYiLajilu2IiHrrW6mcCPHnWc9lSua9nWV3V0Y9_fue2YCD562NAfDkiNdHy20HY99tEPU6vzYOeg7htwvm0-Q4Qes24Rcl5M-LJgJR-aj4W-BOP5y9TR9o2dM_knlW4I2n9RiPdWtO2ePJpJrkXrhVA50PQDoNAVwpT1c Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:43.379283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}] Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 41eb98b3a8434e7e9734eb747047a87d Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.380838 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'd4a331a3-6307-47a9-b9b8-cd94a0217c11'} Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:43.381710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.383949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.385529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Returning 404 to user: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:43.385529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9d700472-5c0b-498e-bbf7-512ff81892f4 tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 404 len: 111 microversion: 2.1 time: 0.062139 Jun 20 12:29:43.385529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 442/886] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:29:43 2022] DELETE /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:43.391132 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:43.391553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] [instance: d4a331a3-6307-47a9-b9b8-cd94a0217c11] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:43.403211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.403663 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.404449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:43.404886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:43.422409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] HTTP exception thrown: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Request method failure captured: Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 HTTP/1.1 Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGam4vxCtgYiLajilu2IiHrrW6mcCPHnWc9lSua9nWV3V0Y9_fue2YCD562NAfDkiNdHy20HY99tEPU6vzYOeg7htwvm0-Q4Qes24Rcl5M-LJgJR-aj4W-BOP5y9TR9o2dM_knlW4I2n9RiPdWtO2ePJpJrkXrhVA50PQDoNAVwpT1c Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:43.424188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3c7566543a6145b7b1a01612aff1c02a"}]}] Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 3c7566543a6145b7b1a01612aff1c02a Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeTestJSON-413042313 Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 41eb98b3a8434e7e9734eb747047a87d Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeTestJSON-413042313-project Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.430096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'd4a331a3-6307-47a9-b9b8-cd94a0217c11'} Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:43.430988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. Jun 20 12:29:43.432460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:43.433817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] Returning 404 to user: Instance d4a331a3-6307-47a9-b9b8-cd94a0217c11 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:43.433817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6db1897f-8df0-4fdd-9682-5d8b653f8bfa tempest-AttachVolumeTestJSON-413042313 tempest-AttachVolumeTestJSON-413042313-project] 10.222.0.64 "GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11" status: 404 len: 111 microversion: 2.1 time: 0.039376 Jun 20 12:29:43.433817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 445/887] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:29:43 2022] GET /compute/v2.1/servers/d4a331a3-6307-47a9-b9b8-cd94a0217c11 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:44.665424 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3a60c355-1c55-43be-9f35-f2d6fb95f5c4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'create', calling method: .version_select at 0x7fe2901deaf0>, body: {"keypair": {"name": "tempest-keypair-408796169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdDvfHwDuVH7MaoKfbER27OuPVB99maDAb3c5KP/IolePWKTviF3GtEXvGiV76y+XqUAld8fsrYjnYtTIJXno/4w2SZxZ+j+cHYNU3WVZfBLTiYJ1unihOjH/2BF/IdiQ=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:44.682230 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-3a60c355-1c55-43be-9f35-f2d6fb95f5c4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:44.687739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-3a60c355-1c55-43be-9f35-f2d6fb95f5c4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for user 65f0d59c17874c949670e0e81c5b74f4 and project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:44.788468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3a60c355-1c55-43be-9f35-f2d6fb95f5c4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.317487 Jun 20 12:29:44.789367 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 443/888] 10.222.0.64 () {62 vars in 1199 bytes} [Mon Jun 20 12:29:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 319 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:29:48.899149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-270067447", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6271bc85-da09-4b74-920d-ca8776e6507c"}], "security_groups": [{"name": "tempest-securitygroup--80256739"}], "key_name": "tempest-keypair-408796169", "user_data": "}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:49.040356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] validate_networks() for [('6271bc85-da09-4b74-920d-ca8776e6507c', None, None, None, None, None)] {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:29:49.739411 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:29:49.739865 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:29:49.740384 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:29:49.740797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:29:49.741213 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:29:49.750161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:49.750613 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:49.751460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:49.751880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:49.770267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:29:49.774317 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for user 65f0d59c17874c949670e0e81c5b74f4 and project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:29:49.785552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:29:49.787904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:29:49.926939 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-371ef583-12f2-4ce5-989b-484ecf560830 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.033883 Jun 20 12:29:49.927569 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 446/889] 10.222.0.64 () {62 vars in 1187 bytes} [Mon Jun 20 12:29:48 2022] POST /compute/v2.1/servers => generated 400 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:29:49.938636 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ac43a664-8cd0-4f10-9084-2f8dacbb86e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:49.943858 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ac43a664-8cd0-4f10-9084-2f8dacbb86e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:50.022421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ac43a664-8cd0-4f10-9084-2f8dacbb86e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:50.033067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ac43a664-8cd0-4f10-9084-2f8dacbb86e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:50.035841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ac43a664-8cd0-4f10-9084-2f8dacbb86e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:50.053580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ac43a664-8cd0-4f10-9084-2f8dacbb86e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1280 microversion: 2.20 time: 0.103502 Jun 20 12:29:50.053580 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 444/890] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:49 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:29:51.063244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-08ed595d-7b46-4165-abd2-e15fd1370d9a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:51.064194 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-08ed595d-7b46-4165-abd2-e15fd1370d9a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:51.130754 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-08ed595d-7b46-4165-abd2-e15fd1370d9a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:51.141348 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-08ed595d-7b46-4165-abd2-e15fd1370d9a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:51.142856 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-08ed595d-7b46-4165-abd2-e15fd1370d9a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:51.144152 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-08ed595d-7b46-4165-abd2-e15fd1370d9a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1280 microversion: 2.20 time: 0.086957 Jun 20 12:29:51.144712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 447/891] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:51 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:29:51.962689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b42bb486-6f1e-4132-ad76-0ab51e01f2e4 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Action: 'create', calling method: .version_select at 0x7fe290263c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1439821264", "metadata": {"Type": "work"}}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:52.169468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:52.169468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:52.178577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.179226 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:52.180267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:52.181905 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:52.293491 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:52.305744 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:52.308042 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:52.310388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e52b4d69-1f77-48d9-bfaa-ad307237ea6e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1332 microversion: 2.20 time: 0.151453 Jun 20 12:29:52.311628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 448/892] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:52 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:29:52.931305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b42bb486-6f1e-4132-ad76-0ab51e01f2e4 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.110188 Jun 20 12:29:52.932185 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 445/893] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 20 12:29:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1112 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 12:29:52.952453 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ee3edcb7-e950-4b92-9e0d-683baabf6907 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Calling method '.version_select at 0x7fe290861e50>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:53.061557 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ee3edcb7-e950-4b92-9e0d-683baabf6907 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0" status: 200 len: 353 microversion: 2.1 time: 0.117304 Jun 20 12:29:53.062630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 449/894] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:29:52 2022] GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:53.332497 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:53.333103 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:53.340568 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.341026 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.341876 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.342322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.371111 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ce78c23b-9001-4c3c-abfb-6886b870a2a1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:53.371706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ce78c23b-9001-4c3c-abfb-6886b870a2a1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:53.390977 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce78c23b-9001-4c3c-abfb-6886b870a2a1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.391347 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce78c23b-9001-4c3c-abfb-6886b870a2a1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.392122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce78c23b-9001-4c3c-abfb-6886b870a2a1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:53.392555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ce78c23b-9001-4c3c-abfb-6886b870a2a1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:53.410530 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:53.419577 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:53.421228 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:53.421635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ce78c23b-9001-4c3c-abfb-6886b870a2a1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/ips" status: 200 len: 149 microversion: 2.1 time: 0.055149 Jun 20 12:29:53.428030 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b6fb9423-781a-4cde-8756-78f78375a912 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1338 microversion: 2.20 time: 0.096586 Jun 20 12:29:53.428896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 450/895] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:29:53 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:29:53.429014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 446/896] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:53 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:29:54.076486 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-222c3a9d-783b-49dc-8a9a-e76954321a92 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Calling method '.version_select at 0x7fe295251d30>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.133966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-222c3a9d-783b-49dc-8a9a-e76954321a92 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0" status: 200 len: 354 microversion: 2.1 time: 0.061366 Jun 20 12:29:54.134556 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 451/897] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:29:54 2022] GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:54.155797 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-15c6eeb5-31a7-4105-a877-8183d9e616ed tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Calling method '.version_select at 0x7fe2901def70>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.223876 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-15c6eeb5-31a7-4105-a877-8183d9e616ed tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0" status: 200 len: 354 microversion: 2.1 time: 0.078770 Jun 20 12:29:54.224944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 447/898] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:29:54 2022] GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:54.239323 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-aa88e2e8-f962-49f5-8a3a-964101b3372a tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Calling method '.version_select at 0x7fe295251a60>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.447635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.448510 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:54.455128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.455745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.457085 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:54.457761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:54.463731 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.552163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-aa88e2e8-f962-49f5-8a3a-964101b3372a tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0" status: 202 len: 0 microversion: 2.1 time: 0.315095 Jun 20 12:29:54.553745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 452/899] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:29:54 2022] DELETE /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:29:54.564568 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d6b504ea-118c-4f91-b622-e256ecdb278c tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Calling method '.version_select at 0x7fe29088d670>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:54.624461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:54.634053 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:54.635778 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:54.636694 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d6b504ea-118c-4f91-b622-e256ecdb278c tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0" status: 200 len: 353 microversion: 2.1 time: 0.078100 Jun 20 12:29:54.636895 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8275fb16-4f18-41a1-bf59-81f033926905 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.195607 Jun 20 12:29:54.637267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 453/900] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:29:54 2022] GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:54.637697 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 448/901] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:54 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:29:55.241518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-bb692916-00f0-4893-b6de-302908195c1c req-010885e9-027d-4c0b-8f75-a1d2aa68ec01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f89bc6b5-c488-4237-b3ca-c18adfee49e0", "tag": "4a2773eb-9f13-4624-b153-cc5009b4ecd3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:55.250792 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-bb692916-00f0-4893-b6de-302908195c1c req-010885e9-027d-4c0b-8f75-a1d2aa68ec01 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.251235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-bb692916-00f0-4893-b6de-302908195c1c req-010885e9-027d-4c0b-8f75-a1d2aa68ec01 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.263119 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-bb692916-00f0-4893-b6de-302908195c1c req-010885e9-027d-4c0b-8f75-a1d2aa68ec01 service nova] Creating event network-changed:4a2773eb-9f13-4624-b153-cc5009b4ecd3 for instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 on hv-cinder-83697 Jun 20 12:29:55.268013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-bb692916-00f0-4893-b6de-302908195c1c req-010885e9-027d-4c0b-8f75-a1d2aa68ec01 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036172 Jun 20 12:29:55.269473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 454/902] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:55.340586 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8f420daa-4509-4417-b72d-17ca65cf3bd7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce29a590-fdfb-4035-b3ef-d6b8c2d98f39"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:55.342334 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8f420daa-4509-4417-b72d-17ca65cf3bd7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:55.353606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f420daa-4509-4417-b72d-17ca65cf3bd7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.354632 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f420daa-4509-4417-b72d-17ca65cf3bd7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.355954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f420daa-4509-4417-b72d-17ca65cf3bd7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.356694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8f420daa-4509-4417-b72d-17ca65cf3bd7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.650170 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1d93a0f9-a5da-4a49-9815-b5fc28f12649 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Calling method '.version_select at 0x7fe295251280>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:55.680527 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-1d93a0f9-a5da-4a49-9815-b5fc28f12649 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] HTTP exception thrown: Volume 2f374a6d-4a72-4d20-bade-6e8374d99fa0 could not be found. Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1d93a0f9-a5da-4a49-9815-b5fc28f12649 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Request method failure captured: Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0 HTTP/1.1 Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGg_yy9YQeekRwSG-tOJ0SXr7IR-vO2dfe5NXMeSz-abVVnfNvvTb7P4AZGLSr4UAPG7loYDyvekLYW7paYOO200D-JdY0S_06t8Q9yndxEmRnHGnetRNN_iOZPq6j_P5Lxi3eHDMF4DfyHQmL-suIxL2WeSTIJ80FmsONHVlH9MIDo Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 57e0b7ebea1240a69f600c2828b732fb Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesGetTestJSON-352927988 Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:55.682640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_57e0b7ebea1240a69f600c2828b732fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/57e0b7ebea1240a69f600c2828b732fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57e0b7ebea1240a69f600c2828b732fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57e0b7ebea1240a69f600c2828b732fb"}]}] Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesGetTestJSON-352927988 Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 57e0b7ebea1240a69f600c2828b732fb Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesGetTestJSON-352927988 Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesGetTestJSON-352927988-project Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 79edabc69ad14bc48685dc297c38b943 Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesGetTestJSON-352927988-project Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Volume 2f374a6d-4a72-4d20-bade-6e8374d99fa0 could not be found. Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '2f374a6d-4a72-4d20-bade-6e8374d99fa0'} Jun 20 12:29:55.684176 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f374a6d-4a72-4d20-bade-6e8374d99fa0 could not be found. (HTTP 404) (Request-ID: req-fb72a5ee-7d49-4ca4-8431-eff802ec582d) Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:55.685023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:29:55.686342 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f374a6d-4a72-4d20-bade-6e8374d99fa0 could not be found. Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:29:55.688464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f374a6d-4a72-4d20-bade-6e8374d99fa0 could not be found. Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f374a6d-4a72-4d20-bade-6e8374d99fa0 could not be found. Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1d93a0f9-a5da-4a49-9815-b5fc28f12649 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] Returning 404 to user: Volume 2f374a6d-4a72-4d20-bade-6e8374d99fa0 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1d93a0f9-a5da-4a49-9815-b5fc28f12649 tempest-VolumesGetTestJSON-352927988 tempest-VolumesGetTestJSON-352927988-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0" status: 404 len: 109 microversion: 2.1 time: 0.039274 Jun 20 12:29:55.690904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 455/903] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:29:55 2022] GET /compute/v2.1/os-volumes/2f374a6d-4a72-4d20-bade-6e8374d99fa0 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:29:55.701554 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:55.703522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:55.711409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.711866 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.712651 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:55.713090 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:55.917613 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:55.927049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:55.932756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:55.932756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-273792f1-0561-4025-b1c3-fc1c4bfdb736 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.244344 Jun 20 12:29:55.932756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 456/904] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:55 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:29:56.548565 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8f420daa-4509-4417-b72d-17ca65cf3bd7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "POST /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212778 Jun 20 12:29:56.549656 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 449/905] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 20 12:29:55 2022] POST /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments => generated 194 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:29:56.947824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:56.948463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:56.955493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.956452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:56.957517 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:56.958170 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:57.111977 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:57.120234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:57.121762 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:57.122911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-db95ea08-91bb-427e-87ee-ba638143c81c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.179209 Jun 20 12:29:57.123462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 457/906] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:56 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:29:58.142867 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:58.144806 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:58.150484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.150938 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.151726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:58.152170 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:58.290727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:58.298763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:58.300399 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:58.301517 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c703c647-1f43-4432-ad39-0005da23ca4d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.163747 Jun 20 12:29:58.302123 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 450/907] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:58 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:29:58.556939 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-86c26cf0-15cf-405e-97bc-14ee443f8128 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Action: 'create', calling method: .version_select at 0x7fe2914c5af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1995234331", "metadata": {"Type": "work"}}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-86c26cf0-15cf-405e-97bc-14ee443f8128 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Request method failure captured: Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 122 Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGhG9HD-a6aTYh_QFIz3NwzoAn4Ecst4VWF6q_OabAOPkJYX55g_Mwu9iPmIJf9CZxgIGPbaGH7fxzEihFRXlJjUcnDuf8VeihcwBMkVE9NKQqevcuC1GhyzToH5xaUCoR4mtUF2AEBzmy1p3WJWV01htpkmNtJYxpRKIJnzHcjW7UA Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:58.576553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}] Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 249d5bbb105947d5b2e3ff7b1ccab4c2 Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1995234331", "metadata": {"Type": "work"}}} Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:29:58.578201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1995234331', 'metadata': {'Type': 'work'}}}} Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:58.579209 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:29:58.580801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:29:58.582736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 12:29:58.582736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.582736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-86c26cf0-15cf-405e-97bc-14ee443f8128 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:58.582736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-86c26cf0-15cf-405e-97bc-14ee443f8128 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132626 Jun 20 12:29:58.582736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 458/908] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 20 12:29:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:29:58.588544 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9d83c21e-37e8-42bc-b745-f308f47ac3e0 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Action: 'create', calling method: .version_select at 0x7fe29027f790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1391752517", "metadata": {"Type": "work"}}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9d83c21e-37e8-42bc-b745-f308f47ac3e0 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Request method failure captured: Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 120 Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGhG9HD-a6aTYh_QFIz3NwzoAn4Ecst4VWF6q_OabAOPkJYX55g_Mwu9iPmIJf9CZxgIGPbaGH7fxzEihFRXlJjUcnDuf8VeihcwBMkVE9NKQqevcuC1GhyzToH5xaUCoR4mtUF2AEBzmy1p3WJWV01htpkmNtJYxpRKIJnzHcjW7UA Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:58.592214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}] Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 249d5bbb105947d5b2e3ff7b1ccab4c2 Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1391752517", "metadata": {"Type": "work"}}} Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: Jun 20 12:29:58.593794 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1391752517', 'metadata': {'Type': 'work'}}}} Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi '0' Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:58.594905 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:29:58.596564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:29:58.598721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 12:29:58.598721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.598721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9d83c21e-37e8-42bc-b745-f308f47ac3e0 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:58.598721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9d83c21e-37e8-42bc-b745-f308f47ac3e0 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009090 Jun 20 12:29:58.598721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 451/909] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 20 12:29:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:29:58.603509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-442c7ef0-33b3-4155-bfdb-9ce454bffe53 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Action: 'create', calling method: .version_select at 0x7fe29092eca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1374416807", "metadata": {"Type": "work"}}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-442c7ef0-33b3-4155-bfdb-9ce454bffe53 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Request method failure captured: Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 119 Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGhG9HD-a6aTYh_QFIz3NwzoAn4Ecst4VWF6q_OabAOPkJYX55g_Mwu9iPmIJf9CZxgIGPbaGH7fxzEihFRXlJjUcnDuf8VeihcwBMkVE9NKQqevcuC1GhyzToH5xaUCoR4mtUF2AEBzmy1p3WJWV01htpkmNtJYxpRKIJnzHcjW7UA Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:58.605767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}] Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 249d5bbb105947d5b2e3ff7b1ccab4c2 Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1374416807", "metadata": {"Type": "work"}}} Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:29:58.607324 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1374416807', 'metadata': {'Type': 'work'}}}} Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise error Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi '' Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:58.608282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 12:29:58.610010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 12:29:58.611529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 12:29:58.611529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.611529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-442c7ef0-33b3-4155-bfdb-9ce454bffe53 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:58.611529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-442c7ef0-33b3-4155-bfdb-9ce454bffe53 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007375 Jun 20 12:29:58.611529 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 459/910] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 20 12:29:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:29:58.616322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5c31c884-6e5c-48cf-ae1f-256930ca709a tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Calling method '.version_select at 0x7fe29023f9d0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:58.644945 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-5c31c884-6e5c-48cf-ae1f-256930ca709a tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] HTTP exception thrown: Volume tempest-invalid-1401259738 could not be found. Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5c31c884-6e5c-48cf-ae1f-256930ca709a tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Request method failure captured: Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1401259738 HTTP/1.1 Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGhG9HD-a6aTYh_QFIz3NwzoAn4Ecst4VWF6q_OabAOPkJYX55g_Mwu9iPmIJf9CZxgIGPbaGH7fxzEihFRXlJjUcnDuf8VeihcwBMkVE9NKQqevcuC1GhyzToH5xaUCoR4mtUF2AEBzmy1p3WJWV01htpkmNtJYxpRKIJnzHcjW7UA Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:58.649241 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}] Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 249d5bbb105947d5b2e3ff7b1ccab4c2 Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Volume tempest-invalid-1401259738 could not be found. Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'tempest-invalid-1401259738'} Jun 20 12:29:58.650915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1401259738 could not be found. (HTTP 404) (Request-ID: req-4d7bb890-4a1b-43c3-b0fa-241cb15de87c) Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.652624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:29:58.653852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1401259738 could not be found. Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:58.655012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1401259738 could not be found. Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1401259738 could not be found. Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5c31c884-6e5c-48cf-ae1f-256930ca709a tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Returning 404 to user: Volume tempest-invalid-1401259738 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5c31c884-6e5c-48cf-ae1f-256930ca709a tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1401259738" status: 404 len: 99 microversion: 2.1 time: 0.038387 Jun 20 12:29:58.656354 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 452/911] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jun 20 12:29:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1401259738 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 20 12:29:58.661305 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-95114b56-2e0e-43a2-8b58-4a43a83d335d tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003933 Jun 20 12:29:58.661978 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 460/912] 10.222.0.64 () {58 vars in 1139 bytes} [Mon Jun 20 12:29:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 12:29:58.671650 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-67a9dd5e-eb33-4a94-a606-b3b8eb1e7d1d tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003907 Jun 20 12:29:58.672275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 453/913] 10.222.0.64 () {58 vars in 1136 bytes} [Mon Jun 20 12:29:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 12:29:58.682787 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-60999185-9cf2-44b8-8998-e96c7d9eea17 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Calling method '.version_select at 0x7fe2914c53a0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:58.711468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-60999185-9cf2-44b8-8998-e96c7d9eea17 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] HTTP exception thrown: Volume 41aab815-7594-407a-b684-d89ea07f28e2 could not be found. Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-60999185-9cf2-44b8-8998-e96c7d9eea17 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Request method failure captured: Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/os-volumes/41aab815-7594-407a-b684-d89ea07f28e2 HTTP/1.1 Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGhG9HD-a6aTYh_QFIz3NwzoAn4Ecst4VWF6q_OabAOPkJYX55g_Mwu9iPmIJf9CZxgIGPbaGH7fxzEihFRXlJjUcnDuf8VeihcwBMkVE9NKQqevcuC1GhyzToH5xaUCoR4mtUF2AEBzmy1p3WJWV01htpkmNtJYxpRKIJnzHcjW7UA Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:29:58.713414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}] Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 249d5bbb105947d5b2e3ff7b1ccab4c2 Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Volume 41aab815-7594-407a-b684-d89ea07f28e2 could not be found. Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '41aab815-7594-407a-b684-d89ea07f28e2'} Jun 20 12:29:58.714719 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41aab815-7594-407a-b684-d89ea07f28e2 could not be found. (HTTP 404) (Request-ID: req-0f23d202-74a8-4982-a074-92ebad7d9d3d) Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.715542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 12:29:58.716706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41aab815-7594-407a-b684-d89ea07f28e2 could not be found. Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 12:29:58.717898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41aab815-7594-407a-b684-d89ea07f28e2 could not be found. Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41aab815-7594-407a-b684-d89ea07f28e2 could not be found. Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-60999185-9cf2-44b8-8998-e96c7d9eea17 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Returning 404 to user: Volume 41aab815-7594-407a-b684-d89ea07f28e2 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-60999185-9cf2-44b8-8998-e96c7d9eea17 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/41aab815-7594-407a-b684-d89ea07f28e2" status: 404 len: 109 microversion: 2.1 time: 0.036055 Jun 20 12:29:58.719039 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 461/914] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 20 12:29:58 2022] DELETE /compute/v2.1/os-volumes/41aab815-7594-407a-b684-d89ea07f28e2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:58.724522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8f1f76e5-9120-499c-806a-c058a7a4d7a1 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Calling method '.version_select at 0x7fe29023f4c0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:58.750951 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-8f1f76e5-9120-499c-806a-c058a7a4d7a1 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] HTTP exception thrown: Volume 0dc697af-23e7-4bb2-b439-8e01aa6e5220 could not be found. Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8f1f76e5-9120-499c-806a-c058a7a4d7a1 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Request method failure captured: Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/os-volumes/0dc697af-23e7-4bb2-b439-8e01aa6e5220 HTTP/1.1 Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGhG9HD-a6aTYh_QFIz3NwzoAn4Ecst4VWF6q_OabAOPkJYX55g_Mwu9iPmIJf9CZxgIGPbaGH7fxzEihFRXlJjUcnDuf8VeihcwBMkVE9NKQqevcuC1GhyzToH5xaUCoR4mtUF2AEBzmy1p3WJWV01htpkmNtJYxpRKIJnzHcjW7UA Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:29:58.753509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0d03ac1cd2274db5a91fecbd4d1023e9"}]}] Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 0d03ac1cd2274db5a91fecbd4d1023e9 Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-VolumesNegativeTest-1961845260 Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 249d5bbb105947d5b2e3ff7b1ccab4c2 Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-VolumesNegativeTest-1961845260-project Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Volume 0dc697af-23e7-4bb2-b439-8e01aa6e5220 could not be found. Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '0dc697af-23e7-4bb2-b439-8e01aa6e5220'} Jun 20 12:29:58.755487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0dc697af-23e7-4bb2-b439-8e01aa6e5220 could not be found. (HTTP 404) (Request-ID: req-bd586328-eb14-47f9-82f2-2b6b10511f94) Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.756463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 12:29:58.757949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0dc697af-23e7-4bb2-b439-8e01aa6e5220 could not be found. Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 12:29:58.759289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0dc697af-23e7-4bb2-b439-8e01aa6e5220 could not be found. Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0dc697af-23e7-4bb2-b439-8e01aa6e5220 could not be found. Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8f1f76e5-9120-499c-806a-c058a7a4d7a1 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] Returning 404 to user: Volume 0dc697af-23e7-4bb2-b439-8e01aa6e5220 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8f1f76e5-9120-499c-806a-c058a7a4d7a1 tempest-VolumesNegativeTest-1961845260 tempest-VolumesNegativeTest-1961845260-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/0dc697af-23e7-4bb2-b439-8e01aa6e5220" status: 404 len: 109 microversion: 2.1 time: 0.034380 Jun 20 12:29:58.760704 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 454/915] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 20 12:29:58 2022] GET /compute/v2.1/os-volumes/0dc697af-23e7-4bb2-b439-8e01aa6e5220 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:59.321101 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:29:59.321782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:29:59.325654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:59.330421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:59.331683 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:59.332593 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:29:59.333139 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:29:59.492813 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:59.501717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:59.503468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:29:59.504753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-119c1ca8-8c1c-46a4-9f1d-03e8185b0fd4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.187954 Jun 20 12:29:59.505310 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 462/916] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:29:59 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:00.520767 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=6 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:00.525432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:00.526073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:00.532072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:00.532527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:00.533301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:00.533745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:00.671658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:00.680301 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:00.681931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:00.683059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8a399abf-fd47-4b69-8d57-ddfb4eb2030f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.164309 Jun 20 12:30:00.683617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 455/917] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:00 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:30:01.426969 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-077f8acb-55a0-40cf-910b-8b50aca7f947 req-5518999e-e123-4d6c-91d3-8428c02de80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89bc6b5-c488-4237-b3ca-c18adfee49e0", "name": "network-vif-plugged", "status": "completed", "tag": "4a2773eb-9f13-4624-b153-cc5009b4ecd3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:01.430921 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.432046 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=8 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.437694 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-077f8acb-55a0-40cf-910b-8b50aca7f947 req-5518999e-e123-4d6c-91d3-8428c02de80d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.438196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-077f8acb-55a0-40cf-910b-8b50aca7f947 req-5518999e-e123-4d6c-91d3-8428c02de80d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.449757 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-077f8acb-55a0-40cf-910b-8b50aca7f947 req-5518999e-e123-4d6c-91d3-8428c02de80d service nova] Creating event network-vif-plugged:4a2773eb-9f13-4624-b153-cc5009b4ecd3 for instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 on hv-cinder-83697 Jun 20 12:30:01.455069 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-077f8acb-55a0-40cf-910b-8b50aca7f947 req-5518999e-e123-4d6c-91d3-8428c02de80d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031764 Jun 20 12:30:01.456580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 463/918] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:30:01.702368 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:01.702986 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:01.709614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.710150 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.711140 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:01.711610 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:01.879972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:01.888387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:01.889994 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:01.891109 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-52b25edb-d10e-440d-b782-dbb083949147 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.192721 Jun 20 12:30:01.891658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 456/919] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:01 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:02.911625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:02.912446 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:02.919805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:02.920363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:02.921512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:02.922007 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:03.063666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:03.073318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:03.074793 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:03.076024 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c8e4c28c-9a1c-4188-8448-1feb01092cb3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1404 microversion: 2.20 time: 0.171257 Jun 20 12:30:03.076578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 464/920] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:02 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:04.094687 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:04.095317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:04.102468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.106124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.106124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.106124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.257335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:04.265915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:04.267542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:04.269345 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3e4e9d78-9e85-47be-9716-964f7179d2dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1595 microversion: 2.20 time: 0.178095 Jun 20 12:30:04.269930 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 457/921] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:04 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1595 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:04.287966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-24a0eaa0-a068-4414-835b-453f9e7637bd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:04.288571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-24a0eaa0-a068-4414-835b-453f9e7637bd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:04.296173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-24a0eaa0-a068-4414-835b-453f9e7637bd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.296617 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-24a0eaa0-a068-4414-835b-453f9e7637bd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.297375 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-24a0eaa0-a068-4414-835b-453f9e7637bd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:04.297890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-24a0eaa0-a068-4414-835b-453f9e7637bd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:04.302439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:04.377338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-24a0eaa0-a068-4414-835b-453f9e7637bd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094004 Jun 20 12:30:04.378227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 465/922] 10.222.0.64 () {60 vars in 1315 bytes} [Mon Jun 20 12:30:04 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:30:05.258682 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:05.260700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:05.266559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.267013 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.267804 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.268226 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.356027 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'services' on Instance uuid a52dbe69-b2da-4efe-a1ee-2559900a2632 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:05.475300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-fba90a74-a973-44e4-a7ac-ab5ec46a8aff req-00951552-44ee-4122-87d7-7dcf4a97e11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f89bc6b5-c488-4237-b3ca-c18adfee49e0", "tag": "4a2773eb-9f13-4624-b153-cc5009b4ecd3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:05.483749 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fba90a74-a973-44e4-a7ac-ab5ec46a8aff req-00951552-44ee-4122-87d7-7dcf4a97e11a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.484229 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fba90a74-a973-44e4-a7ac-ab5ec46a8aff req-00951552-44ee-4122-87d7-7dcf4a97e11a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.495273 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-fba90a74-a973-44e4-a7ac-ab5ec46a8aff req-00951552-44ee-4122-87d7-7dcf4a97e11a service nova] Creating event network-changed:4a2773eb-9f13-4624-b153-cc5009b4ecd3 for instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 on hv-cinder-83697 Jun 20 12:30:05.500093 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-fba90a74-a973-44e4-a7ac-ab5ec46a8aff req-00951552-44ee-4122-87d7-7dcf4a97e11a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029368 Jun 20 12:30:05.500877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 466/923] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:30:05.683888 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4d64e8b7-7c5a-458b-b401-4722baade432 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments/ce29a590-fdfb-4035-b3ef-d6b8c2d98f39" status: 202 len: 0 microversion: 2.1 time: 0.428533 Jun 20 12:30:05.689385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 458/924] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 20 12:30:05 2022] DELETE /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments/ce29a590-fdfb-4035-b3ef-d6b8c2d98f39 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:30:05.696523 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4c25bb5c-eb57-41e7-9652-8197d84e00d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:05.698460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4c25bb5c-eb57-41e7-9652-8197d84e00d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:05.709624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4c25bb5c-eb57-41e7-9652-8197d84e00d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.710531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4c25bb5c-eb57-41e7-9652-8197d84e00d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.711504 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4c25bb5c-eb57-41e7-9652-8197d84e00d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:05.712245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4c25bb5c-eb57-41e7-9652-8197d84e00d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:05.754726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4c25bb5c-eb57-41e7-9652-8197d84e00d9 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063983 Jun 20 12:30:05.755870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 467/925] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:30:05 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:06.767317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a031c9c2-9056-41e3-86cc-0963edae1522 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:06.768428 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a031c9c2-9056-41e3-86cc-0963edae1522 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:06.775251 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a031c9c2-9056-41e3-86cc-0963edae1522 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.775705 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a031c9c2-9056-41e3-86cc-0963edae1522 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:06.776480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a031c9c2-9056-41e3-86cc-0963edae1522 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.776924 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a031c9c2-9056-41e3-86cc-0963edae1522 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:06.808614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a031c9c2-9056-41e3-86cc-0963edae1522 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045590 Jun 20 12:30:06.809165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 459/926] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 20 12:30:06 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 12:30:06.868102 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:06.868749 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:06.878708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.878708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:06.878708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:06.878708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:06.907514 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:30:07.215438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e1cf8510-90d2-49fc-81e2-9120c58af57b tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 204 len: 0 microversion: 2.1 time: 0.350991 Jun 20 12:30:07.216057 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 468/927] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:06 2022] DELETE /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:30:07.224912 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:07.225620 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:07.232980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:07.233432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:07.234226 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:07.234662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:07.371473 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:07.379407 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-376855ae-7ff2-4cb9-87a1-a59452fa70ac tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1681 microversion: 2.1 time: 0.159036 Jun 20 12:30:07.379980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 460/928] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:07 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:08.397241 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:08.398075 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:08.404876 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.405325 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.406130 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:08.406559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:08.538460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:08.546332 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b44ac178-56b8-4c11-b4cc-e27cd36a95e1 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1681 microversion: 2.1 time: 0.153591 Jun 20 12:30:08.546892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 469/929] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:08 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:09.563125 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:09.563799 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:09.570700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:09.571063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.571844 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:09.572287 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.647662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:09.657380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-28859049-193b-4de3-83f3-33a062951a2d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1613 microversion: 2.1 time: 0.098124 Jun 20 12:30:09.658316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 461/930] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:09 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:09.897251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-79c1101c-c67a-4fe0-b99a-51e6a2112c26 req-c291d05a-0ca8-4256-9d6f-21b3ea786bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52dbe69-b2da-4efe-a1ee-2559900a2632", "name": "network-vif-deleted", "tag": "8d767632-02a0-41c1-b527-257611deb664"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:09.906502 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-79c1101c-c67a-4fe0-b99a-51e6a2112c26 req-c291d05a-0ca8-4256-9d6f-21b3ea786bea service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:09.907152 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-79c1101c-c67a-4fe0-b99a-51e6a2112c26 req-c291d05a-0ca8-4256-9d6f-21b3ea786bea service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:09.919869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-79c1101c-c67a-4fe0-b99a-51e6a2112c26 req-c291d05a-0ca8-4256-9d6f-21b3ea786bea service nova] Creating event network-vif-deleted:8d767632-02a0-41c1-b527-257611deb664 for instance a52dbe69-b2da-4efe-a1ee-2559900a2632 on hv-cinder-83697 Jun 20 12:30:09.926097 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-79c1101c-c67a-4fe0-b99a-51e6a2112c26 req-c291d05a-0ca8-4256-9d6f-21b3ea786bea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032879 Jun 20 12:30:09.927301 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 470/931] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:10.675906 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:10.676555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:10.683361 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:10.683710 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:10.684507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:10.684950 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:10.719628 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:10.720251 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:10.720824 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lazy-loading 'fault' on Instance uuid a52dbe69-b2da-4efe-a1ee-2559900a2632 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:10.770471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '787efd65008840748e98f9e46e11a1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5df9a6a9764dde96014824c7456331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:10.781453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8e17f57d-d777-4346-962a-7fcec9d449f7 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 200 len: 1331 microversion: 2.1 time: 0.109606 Jun 20 12:30:10.782251 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 462/932] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:10 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:11.799668 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:11.801193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:11.807987 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.808429 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:11.809187 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:11.809616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:11.824034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 HTTP/1.1 Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:30:11.825689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:11.827433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'a52dbe69-b2da-4efe-a1ee-2559900a2632'} Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:11.828262 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:11.829614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:11.830880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:11.830880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-07508aa1-4db8-4c0e-80db-6dadf31784a6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 404 len: 111 microversion: 2.1 time: 0.031734 Jun 20 12:30:11.830880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 471/933] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:11 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:11.836401 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f2fad701-8adb-441a-bb1f-d870418ca8c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '.version_select at 0x7fe29024f820>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:11.944486 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f2fad701-8adb-441a-bb1f-d870418ca8c8 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-270100773" status: 202 len: 0 microversion: 2.1 time: 0.110546 Jun 20 12:30:11.945614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 463/934] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jun 20 12:30:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-270100773 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:30:12.810846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:12.811399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:12.818017 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:12.818543 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:12.819293 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:12.819722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:12.847857 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Going to try to terminate instance {{(pid=118092) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:30:13.161171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-74b73a4e-3c82-41b2-9df4-67ad81cfd75f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "DELETE /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 204 len: 0 microversion: 2.1 time: 0.353979 Jun 20 12:30:13.161717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 472/935] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:12 2022] DELETE /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:30:13.170660 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:13.171280 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:13.180124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:13.180592 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:13.181363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:13.181875 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:13.343018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:13.351866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7f666006-a29a-44c6-9b93-443c2ad9b77b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1577 microversion: 2.1 time: 0.185377 Jun 20 12:30:13.352433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 464/936] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:13 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:14.028172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:14.028824 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:14.037357 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.037832 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.038621 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.039065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.053592 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 HTTP/1.1 Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:30:14.055338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.056786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'a52dbe69-b2da-4efe-a1ee-2559900a2632'} Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:14.057531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.058817 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.060087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:14.060087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-48a2b0d1-91dd-4218-95dd-7deb200e9117 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 404 len: 111 microversion: 2.1 time: 0.032890 Jun 20 12:30:14.060087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 473/937] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:14 2022] DELETE /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:14.065643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:14.071179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: a52dbe69-b2da-4efe-a1ee-2559900a2632] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:14.072167 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.072611 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.073726 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.073880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.089880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 HTTP/1.1 Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:30:14.091545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.093285 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'a52dbe69-b2da-4efe-a1ee-2559900a2632'} Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:14.094172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. Jun 20 12:30:14.095531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:14.096822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance a52dbe69-b2da-4efe-a1ee-2559900a2632 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:14.096822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-89b498c8-7051-4d4b-b96c-d77522f77c70 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632" status: 404 len: 111 microversion: 2.1 time: 0.031328 Jun 20 12:30:14.096822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 465/938] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:14 2022] GET /compute/v2.1/servers/a52dbe69-b2da-4efe-a1ee-2559900a2632 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:14.370335 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:14.371021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:14.377429 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.378580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.379706 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:14.379998 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:14.520708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:14.528564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-35fc11d1-3eb6-4d9f-a51a-0d2c3ea412a7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1577 microversion: 2.1 time: 0.163065 Jun 20 12:30:14.529130 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 474/939] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:14 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:15.430266 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:15.430825 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:15.433268 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:15.438083 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.438536 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.439318 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.439796 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.453603 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: DELETE /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 HTTP/1.1 Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:30:15.455201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.456968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'd46973eb-c676-4cd1-9b9b-5e4a2943c518'} Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:15.458008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.459474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.461386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:15.461386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-79554649-f40b-4e84-a9c3-aac9a774bac4 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 404 len: 111 microversion: 2.1 time: 0.030178 Jun 20 12:30:15.461386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 466/940] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:15 2022] DELETE /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:15.467482 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:15.468089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: d46973eb-c676-4cd1-9b9b-5e4a2943c518] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:15.475371 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.475972 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.476681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.477681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.492092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 HTTP/1.1 Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:30:15.493627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.495201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'd46973eb-c676-4cd1-9b9b-5e4a2943c518'} Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:15.495934 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. Jun 20 12:30:15.497173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.498326 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance d46973eb-c676-4cd1-9b9b-5e4a2943c518 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:15.498326 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-48c5025e-7433-45aa-9bdc-fd0defdce86d tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518" status: 404 len: 111 microversion: 2.1 time: 0.031494 Jun 20 12:30:15.498326 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 475/941] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:15 2022] GET /compute/v2.1/servers/d46973eb-c676-4cd1-9b9b-5e4a2943c518 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:15.503965 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:15.504475 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:15.510945 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.511394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.512181 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.512624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.533248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: DELETE /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 HTTP/1.1 Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:30:15.535535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.537129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '723b236d-b42a-49bd-82e5-8cdbd77ae671'} Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:15.537926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.542387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.544238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:15.544238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5527e12f-1e30-4fc6-9b24-5a3ca912b74f tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 404 len: 111 microversion: 2.1 time: 0.037258 Jun 20 12:30:15.544238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 467/942] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:15 2022] DELETE /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:15.548240 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:15.548846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: 723b236d-b42a-49bd-82e5-8cdbd77ae671] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:15.549323 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:15.550157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:15.555396 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.555838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.556286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.556604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.556738 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.557036 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.557516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.558234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.574163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 HTTP/1.1 Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:30:15.575698 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.577496 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '723b236d-b42a-49bd-82e5-8cdbd77ae671'} Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:15.582002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. Jun 20 12:30:15.583476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:15.585280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance 723b236d-b42a-49bd-82e5-8cdbd77ae671 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:15.585280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d7b92856-d5bc-4e73-b322-c393caa4b9f6 tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671" status: 404 len: 111 microversion: 2.1 time: 0.032735 Jun 20 12:30:15.585280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 476/943] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:15 2022] GET /compute/v2.1/servers/723b236d-b42a-49bd-82e5-8cdbd77ae671 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:15.642437 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:15.654889 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cb42e5f1-671d-44fd-80a7-4452b692e73d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1509 microversion: 2.1 time: 0.109589 Jun 20 12:30:15.656023 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 468/944] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:15 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1509 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:15.818572 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-54c22f88-53a5-4f0e-a812-5b6c3091ff4a req-128de7a7-0bc4-4f7f-8628-082043544d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36070a3e-9c08-45f3-a574-2412cabfe0ed", "name": "network-vif-deleted", "tag": "53e7a966-d8ba-4ea1-befa-d940c1785d69"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:15.836810 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-54c22f88-53a5-4f0e-a812-5b6c3091ff4a req-128de7a7-0bc4-4f7f-8628-082043544d59 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:15.837947 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-54c22f88-53a5-4f0e-a812-5b6c3091ff4a req-128de7a7-0bc4-4f7f-8628-082043544d59 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:15.851979 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-54c22f88-53a5-4f0e-a812-5b6c3091ff4a req-128de7a7-0bc4-4f7f-8628-082043544d59 service nova] Creating event network-vif-deleted:53e7a966-d8ba-4ea1-befa-d940c1785d69 for instance 36070a3e-9c08-45f3-a574-2412cabfe0ed on hv-cinder-83697 Jun 20 12:30:15.868164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-54c22f88-53a5-4f0e-a812-5b6c3091ff4a req-128de7a7-0bc4-4f7f-8628-082043544d59 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053163 Jun 20 12:30:15.874840 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 477/945] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:16.672854 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:16.673400 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:16.682829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.683500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.684294 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.684735 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.701601 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:16.719980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.720337 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.720792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid 36070a3e-9c08-45f3-a574-2412cabfe0ed {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:16.764166 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:16.772183 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7bc36ae1-dd0a-48b2-b1d9-14c494dbf7ca tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 200 len: 1230 microversion: 2.1 time: 0.103340 Jun 20 12:30:16.772783 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 469/946] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:16 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:16.921206 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:16.921967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:16.929858 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.932155 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.932155 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.932155 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.946684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a HTTP/1.1 Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:30:16.948356 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.949976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'b954edf9-f964-4714-b270-e9f9ee51a80a'} Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:16.950842 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.952163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.960646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:16.960646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5880e1f7-1a52-48cd-91a7-0c12346bb24a tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 404 len: 111 microversion: 2.1 time: 0.033817 Jun 20 12:30:16.960646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 478/947] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:16 2022] DELETE /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:16.961721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:16.962026 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] [instance: b954edf9-f964-4714-b270-e9f9ee51a80a] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:16.970494 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.970842 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.972479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:16.972976 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:16.991224 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] HTTP exception thrown: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Request method failure captured: Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a HTTP/1.1 Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGasXNM1j6OmOU8Vr9pn-XlOgZ0kTsoOtuTi-Dh6G6pyHh6D_dZskw8dwWeKB3mU6Bvm_WUdCEzZDBjS3GDA5fVHiV2hYvDlpTJjhIuWc31GRJxxPktK1uwJVsll1qNiWQ155mroeQoN6xmCf8is_AKb_tj2MpmOjGMC-Zhv-QGoSVc Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:30:16.992798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2f5df9a6a9764dde96014824c7456331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2f5df9a6a9764dde96014824c7456331"}]}] Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 2f5df9a6a9764dde96014824c7456331 Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-187845647 Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 787efd65008840748e98f9e46e11a1eb Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeNegativeTest-187845647-project Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.994506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'b954edf9-f964-4714-b270-e9f9ee51a80a'} Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:16.995621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. Jun 20 12:30:16.996988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:16.998333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] Returning 404 to user: Instance b954edf9-f964-4714-b270-e9f9ee51a80a could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:16.998333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-624565f5-aa3a-4a78-a42f-3b9c25eae6be tempest-AttachVolumeNegativeTest-187845647 tempest-AttachVolumeNegativeTest-187845647-project] 10.222.0.64 "GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a" status: 404 len: 111 microversion: 2.1 time: 0.039881 Jun 20 12:30:16.998333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 470/948] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:16 2022] GET /compute/v2.1/servers/b954edf9-f964-4714-b270-e9f9ee51a80a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:30:17.809112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:17.809880 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:17.823839 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:17.825534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:17.826365 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:17.826814 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:17.845123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] HTTP exception thrown: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Request method failure captured: Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed HTTP/1.1 Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGdzAnoHw_UER1z20ncn1-RbECz90AKu4yeGKDcKAs5JYpQEM5kbraX8ZksIJSzk67yg1KMivbGKgKlO6jk8gRO5njOOQ_t_Y7NMMIOyiWLWgG4ZZ3UPailrDQMUe33uexeiF9TSGY3RXlCnea5v1QoExwqIAg-SMPt9Z-YmD-LjiRI Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:30:17.848141 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}] Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 648c1ba14f1842a5b4160a7569e3206e Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:30:17.849730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '36070a3e-9c08-45f3-a574-2412cabfe0ed'} Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:17.850678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:30:17.852123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:17.854245 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Returning 404 to user: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:17.856684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ba25d170-b08e-4153-9458-1cda6cfdab25 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 404 len: 111 microversion: 2.1 time: 0.055961 Jun 20 12:30:17.856684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 479/949] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:17 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:17.974743 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-6743126", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1645848315", "security_groups": [{"name": "tempest-secgroup-smoke-2047174386"}], "block_device_mapping_v2": [{"uuid": "01c4cbe9-9e6f-4d5f-98a1-11f7d37184da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7bf56be-1d96-4e0f-a5ab-753fc0e58582"}]}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:18.101714 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] validate_networks() for [('f7bf56be-1d96-4e0f-a5ab-753fc0e58582', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:30:18.571557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:30:18.571557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:30:18.571557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:30:18.571557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:30:18.571557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:30:18.576579 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:18.577034 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:18.577864 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:18.578446 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:18.595485 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:30:18.599899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for user 648c1ba14f1842a5b4160a7569e3206e and project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:30:18.667831 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:30:18.669964 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01c4cbe9-9e6f-4d5f-98a1-11f7d37184da',volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:30:19.454185 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-129592de-b615-4941-aecd-a56ff0d50c47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.483203 Jun 20 12:30:19.455806 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 471/950] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:30:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:30:19.466515 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ebf94a97-eca7-4a02-82f7-bc41729c4d47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:19.467712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ebf94a97-eca7-4a02-82f7-bc41729c4d47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:19.554936 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ebf94a97-eca7-4a02-82f7-bc41729c4d47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:19.571654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ebf94a97-eca7-4a02-82f7-bc41729c4d47 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1092 microversion: 2.1 time: 0.100122 Jun 20 12:30:19.571654 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 480/951] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:19 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1092 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:20.579689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:20.580305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:20.588227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:20.588882 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:20.589671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:20.590131 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:20.702868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:20.715171 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c5af2f51-a2eb-49f5-8dae-e4c6502eb7fe tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1142 microversion: 2.1 time: 0.139291 Jun 20 12:30:20.715393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 472/952] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:20 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1142 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:21.732081 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:21.732695 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:21.740991 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:21.741445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:21.742266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:21.742709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:21.805078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:21.812592 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5b583762-51da-4a97-a577-4c42a8994fa9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1190 microversion: 2.1 time: 0.084605 Jun 20 12:30:21.813105 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 481/953] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:21 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1190 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:22.834343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:22.835765 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:22.844047 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:22.844497 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:22.845436 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:22.846341 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:22.928453 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:22.939777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d170b2d1-f81b-4168-b74a-ad453a78873a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1208 microversion: 2.1 time: 0.113901 Jun 20 12:30:22.941136 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 473/954] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:22 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1208 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:23.961775 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:23.962426 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:23.969019 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:23.969664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:23.970468 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:23.971063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:24.214722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:24.231469 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c264d5bd-0c30-4354-b925-96f849a507c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1276 microversion: 2.1 time: 0.274932 Jun 20 12:30:24.232382 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 482/955] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:23 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1276 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:24.645569 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-f999d632-5ed1-4211-a02a-34bf8af36b1f req-a927c691-faa3-46de-ba97-8d51eb216bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e1194c-76fb-4699-aea3-93553015eb1b", "tag": "450b3ed4-d831-46dd-b515-88afaa090f48"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:24.672378 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f999d632-5ed1-4211-a02a-34bf8af36b1f req-a927c691-faa3-46de-ba97-8d51eb216bf9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:24.672920 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-f999d632-5ed1-4211-a02a-34bf8af36b1f req-a927c691-faa3-46de-ba97-8d51eb216bf9 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:24.720063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-f999d632-5ed1-4211-a02a-34bf8af36b1f req-a927c691-faa3-46de-ba97-8d51eb216bf9 service nova] Creating event network-changed:450b3ed4-d831-46dd-b515-88afaa090f48 for instance 06e1194c-76fb-4699-aea3-93553015eb1b on hv-cinder-83697 Jun 20 12:30:24.737209 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-f999d632-5ed1-4211-a02a-34bf8af36b1f req-a927c691-faa3-46de-ba97-8d51eb216bf9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093248 Jun 20 12:30:24.739485 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 474/956] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:25.249385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:25.250190 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:25.257657 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:25.258144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:25.258914 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:25.259352 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:25.402920 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:25.411894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-bade2cd8-5582-46ae-9991-823bbec64f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.166941 Jun 20 12:30:25.412473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 483/957] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:25 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:26.430413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:26.431136 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:26.437312 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:26.437763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:26.438606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:26.439051 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:26.587248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:26.592223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2e46ac63-d849-4819-bc6f-36074ef5c825 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.167375 Jun 20 12:30:26.592814 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 475/958] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:26 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:27.609616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:27.610327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:27.617047 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:27.617531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:27.618297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:27.618733 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:27.759480 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:27.770777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-58808dd3-6b62-49a5-9901-de390e891e46 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.165041 Jun 20 12:30:27.771745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 484/959] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:27 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:28.788521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:28.789129 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:28.791782 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:28.792596 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=6 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:28.797458 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:28.797934 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:28.798694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:28.799126 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:28.933210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:28.940820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-81df0193-2b89-4c14-b514-af14f1690437 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.156803 Jun 20 12:30:28.941381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 476/960] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:28 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:29.145742 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-276175593", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:29.198848 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.network.neutron [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] validate_networks() for None {{(pid=118092) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:30:29.474424 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Flavor limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:30:29.474872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Image limits 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:30:29.475360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Flavor pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:30:29.475760 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Image pref 0:0:0 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:30:29.476164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.virt.hardware [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118092) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:30:29.485547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.486030 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.486839 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.487362 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.507374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Getting quotas for project 3de2f4a6d04b47eeabc252a4802957d2. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:30:29.512058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.quota [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Getting quotas for user b4fc33384e304e78b36cd36dce23f265 and project 3de2f4a6d04b47eeabc252a4802957d2. Resources: {'ram', 'instances', 'cores'} {{(pid=118092) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:30:29.524641 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Going to run 1 instances... {{(pid=118092) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:30:29.527021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118092) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:30:29.724821 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-5d942f56-0ee3-4b72-826e-1d32e9db4dda tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583439 Jun 20 12:30:29.725466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 485/961] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:30:29.735649 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-eb2f91f6-87f0-4287-8c4d-0e6a3bbf0e6c tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:29.736382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-eb2f91f6-87f0-4287-8c4d-0e6a3bbf0e6c tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:29.791700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-eb2f91f6-87f0-4287-8c4d-0e6a3bbf0e6c tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:29.799233 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-eb2f91f6-87f0-4287-8c4d-0e6a3bbf0e6c tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1214 microversion: 2.1 time: 0.067554 Jun 20 12:30:29.799802 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 477/962] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:29 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:29.958609 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:29.959217 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:29.965732 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.966201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.966957 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:29.967385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:29.982247 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:30.102220 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:30.109883 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0a895d3e-1b5a-41be-8650-f6e70de751bf tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.156100 Jun 20 12:30:30.110443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 486/963] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:29 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:30.816878 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:30.817518 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:30.824658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:30.825112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:30.825915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:30.826356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:30.886106 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:30.893493 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-327bad51-09cd-4b63-9a6b-76f606848186 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1218 microversion: 2.1 time: 0.080888 Jun 20 12:30:30.894171 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 478/964] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:30 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:31.127184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:31.127801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:31.135214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.135666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.136432 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.136874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.269100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:31.276774 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2078d98f-1673-4741-9416-a4365e2b8d4f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.153539 Jun 20 12:30:31.277330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 487/965] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:31 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:31.913175 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:31.913695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:31.920633 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.921093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.921914 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:31.922365 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:31.989942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:31.997529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f2736588-ffe9-472e-844f-d9a383e61df5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1218 microversion: 2.1 time: 0.090742 Jun 20 12:30:31.998155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 479/966] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:31 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:32.293525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:32.294148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:32.301210 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:32.301658 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.302461 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:32.302894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:32.433733 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:32.442089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-45fbbd54-9d9b-4989-9874-b388fbde12a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.151965 Jun 20 12:30:32.442665 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 488/967] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:32 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:33.017164 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:33.018099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:33.024627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.025112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.026017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.026363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.090549 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:33.098262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4683ec82-6cd8-4f00-aad2-59d33e2d7e31 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1210 microversion: 2.1 time: 0.087325 Jun 20 12:30:33.098831 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 480/968] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:33 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:33.459254 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:33.459997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:33.467028 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.467574 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.468560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:33.469001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:33.652133 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:33.660989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0f2c1c83-98fd-4c65-bfe3-1801abb5ec82 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.205955 Jun 20 12:30:33.661794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 489/969] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:33 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:34.117035 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:34.118019 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:34.125700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:34.126306 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:34.129217 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:34.129769 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:34.199943 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:34.209458 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-359071f1-d653-4a86-9919-bce859b55b96 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1272 microversion: 2.1 time: 0.097980 Jun 20 12:30:34.220204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 481/970] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:34 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:34.682954 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:34.683572 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:34.685977 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:34.690980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:34.691678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:34.692504 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:34.692954 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:34.860225 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:34.868556 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-68c6d9ff-e395-4056-9d33-09da1f190157 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.189649 Jun 20 12:30:34.869115 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 490/971] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:34 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:35.227582 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:35.228377 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:35.235479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.242595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:35.242595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.242595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:35.375540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:35.387546 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-518e3cc1-b559-42e0-9490-7833226afe44 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.163948 Jun 20 12:30:35.388233 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 482/972] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:35 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:35.641847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-6d631aee-df47-460d-b811-e1b606a7af07 req-79d5fc80-2398-4af0-9104-8fd63c88177a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e1194c-76fb-4699-aea3-93553015eb1b", "name": "network-vif-plugged", "status": "completed", "tag": "450b3ed4-d831-46dd-b515-88afaa090f48"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:35.656619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-6d631aee-df47-460d-b811-e1b606a7af07 req-79d5fc80-2398-4af0-9104-8fd63c88177a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.657062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-6d631aee-df47-460d-b811-e1b606a7af07 req-79d5fc80-2398-4af0-9104-8fd63c88177a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:35.679040 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-6d631aee-df47-460d-b811-e1b606a7af07 req-79d5fc80-2398-4af0-9104-8fd63c88177a service nova] Creating event network-vif-plugged:450b3ed4-d831-46dd-b515-88afaa090f48 for instance 06e1194c-76fb-4699-aea3-93553015eb1b on hv-cinder-83697 Jun 20 12:30:35.685431 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-6d631aee-df47-460d-b811-e1b606a7af07 req-79d5fc80-2398-4af0-9104-8fd63c88177a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047336 Jun 20 12:30:35.686897 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 491/973] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:35.890949 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:35.892076 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:35.902908 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.909425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:35.909425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:35.909425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:36.081008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:36.092325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7566c4e0-a057-41cd-a95c-034d76a23f63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.209223 Jun 20 12:30:36.093174 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 483/974] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:35 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:36.107597 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-b5789502-a0cb-45fa-8a65-6d5f0833bb52 req-a37f90d9-1997-4aa9-8337-315c466fa32d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4faad293-40eb-47a1-9b27-4822946c3781", "tag": "39521b1e-a09f-4d7a-88a6-2c7f0ee66a24"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:36.119889 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b5789502-a0cb-45fa-8a65-6d5f0833bb52 req-a37f90d9-1997-4aa9-8337-315c466fa32d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:36.120337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-b5789502-a0cb-45fa-8a65-6d5f0833bb52 req-a37f90d9-1997-4aa9-8337-315c466fa32d service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:36.137008 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-b5789502-a0cb-45fa-8a65-6d5f0833bb52 req-a37f90d9-1997-4aa9-8337-315c466fa32d service nova] Creating event network-changed:39521b1e-a09f-4d7a-88a6-2c7f0ee66a24 for instance 4faad293-40eb-47a1-9b27-4822946c3781 on hv-cinder-83697 Jun 20 12:30:36.141532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-b5789502-a0cb-45fa-8a65-6d5f0833bb52 req-a37f90d9-1997-4aa9-8337-315c466fa32d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039437 Jun 20 12:30:36.143185 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 492/975] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:36.404492 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:36.405041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:36.412111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:36.412566 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:36.413346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:36.413790 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:36.545775 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:36.557157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f79cea43-dab4-4c99-8119-ba6b5664cb3a tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.156506 Jun 20 12:30:36.557748 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 484/976] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:36 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:37.109139 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:37.109932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:37.116562 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.117013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:37.117788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.118241 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:37.301328 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:37.309287 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-60c3ba18-94e0-4e83-a1d9-77817241b1c0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1264 microversion: 2.1 time: 0.204451 Jun 20 12:30:37.313970 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 493/977] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:37 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:37.575715 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:37.577901 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:37.588647 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.589089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:37.590066 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:37.596956 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:37.735613 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:37.745118 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3b5ae700-18c0-4413-bbe4-82fe7d3f15a6 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.175743 Jun 20 12:30:37.745690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 485/978] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:37 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:38.326716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:38.327509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:38.334887 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.335341 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.336118 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.336562 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.494079 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:38.501989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3d655067-2979-4c67-9718-19180ac7e389 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1450 microversion: 2.1 time: 0.179217 Jun 20 12:30:38.502610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 494/979] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:38 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1450 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:38.519042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:38.520884 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:38.527172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.527628 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.528407 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.528843 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.684732 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:38.708439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d0abd5c0-d7d4-45eb-be5c-4550fb45bd99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1450 microversion: 2.1 time: 0.193117 Jun 20 12:30:38.709363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 486/980] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:38 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1450 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:38.762845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:38.763457 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:38.772120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.772120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.772120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:38.772120 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:38.930799 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:38.940956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ca69ee17-88fb-4bb2-97a4-79e5b9d115dc tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.181897 Jun 20 12:30:38.945921 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 495/981] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:38 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:39.959543 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:39.961158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:39.975352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:39.979917 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:39.980606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:39.981618 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:39.982393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:40.153270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:40.162834 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6c7cc441-4afe-4f96-8295-a38ba46bef16 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.207582 Jun 20 12:30:40.164570 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 487/982] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:39 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:41.117881 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-00d2438d-fb4a-44e8-837d-76f5e5f357e0 req-49e91d1c-8309-4735-8471-3e6aae383a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e1194c-76fb-4699-aea3-93553015eb1b", "tag": "450b3ed4-d831-46dd-b515-88afaa090f48"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:41.123014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:41.131435 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=8 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:41.131435 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-00d2438d-fb4a-44e8-837d-76f5e5f357e0 req-49e91d1c-8309-4735-8471-3e6aae383a4e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:41.131435 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-00d2438d-fb4a-44e8-837d-76f5e5f357e0 req-49e91d1c-8309-4735-8471-3e6aae383a4e service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:41.158939 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-00d2438d-fb4a-44e8-837d-76f5e5f357e0 req-49e91d1c-8309-4735-8471-3e6aae383a4e service nova] Creating event network-changed:450b3ed4-d831-46dd-b515-88afaa090f48 for instance 06e1194c-76fb-4699-aea3-93553015eb1b on hv-cinder-83697 Jun 20 12:30:41.167581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-00d2438d-fb4a-44e8-837d-76f5e5f357e0 req-49e91d1c-8309-4735-8471-3e6aae383a4e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055750 Jun 20 12:30:41.171549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 496/983] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:41.183474 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:41.184381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:41.194682 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:41.197389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:41.198614 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:41.199136 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:41.369500 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:41.371789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=100 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:41.378154 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-89e3ba24-e90c-42f5-b29f-4e3a2bd599a5 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.201494 Jun 20 12:30:41.379786 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 488/984] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:41 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:41.561736 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c51f2d21-43f6-47e9-bf03-830fd94aa522 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:41.567460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c51f2d21-43f6-47e9-bf03-830fd94aa522 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:41.580694 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c51f2d21-43f6-47e9-bf03-830fd94aa522 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:41.581406 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c51f2d21-43f6-47e9-bf03-830fd94aa522 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:41.583049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c51f2d21-43f6-47e9-bf03-830fd94aa522 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:41.583876 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c51f2d21-43f6-47e9-bf03-830fd94aa522 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:41.614992 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c51f2d21-43f6-47e9-bf03-830fd94aa522 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/ips" status: 200 len: 151 microversion: 2.20 time: 0.061035 Jun 20 12:30:41.615576 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 497/985] 10.222.0.64 () {60 vars in 1288 bytes} [Mon Jun 20 12:30:41 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:30:41.837760 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-e74492da-7af5-4e52-8940-f59879b4331e req-490cedd9-14d6-4e2f-bab9-d62a6c9b4e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4faad293-40eb-47a1-9b27-4822946c3781", "name": "network-vif-plugged", "status": "completed", "tag": "39521b1e-a09f-4d7a-88a6-2c7f0ee66a24"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:41.856478 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-e74492da-7af5-4e52-8940-f59879b4331e req-490cedd9-14d6-4e2f-bab9-d62a6c9b4e2a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:41.856926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-e74492da-7af5-4e52-8940-f59879b4331e req-490cedd9-14d6-4e2f-bab9-d62a6c9b4e2a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:41.872565 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-e74492da-7af5-4e52-8940-f59879b4331e req-490cedd9-14d6-4e2f-bab9-d62a6c9b4e2a service nova] Creating event network-vif-plugged:39521b1e-a09f-4d7a-88a6-2c7f0ee66a24 for instance 4faad293-40eb-47a1-9b27-4822946c3781 on hv-cinder-83697 Jun 20 12:30:41.882108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-e74492da-7af5-4e52-8940-f59879b4331e req-490cedd9-14d6-4e2f-bab9-d62a6c9b4e2a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047333 Jun 20 12:30:41.883227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 489/986] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:42.410737 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:42.412022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:42.423179 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:42.423630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:42.424402 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:42.425010 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:42.610853 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:42.625701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b01096e2-b345-4738-800e-94a66066cb7f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.227630 Jun 20 12:30:42.626327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 498/987] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:42 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:43.646618 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:43.647455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:43.655735 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:43.656138 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:43.657076 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:43.657550 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:43.822682 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:43.830406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9bc6d5a7-a2a3-4ad2-bbe8-ad984cf4795f tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1314 microversion: 2.1 time: 0.190164 Jun 20 12:30:43.830971 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 490/988] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:43 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:44.780764 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:44.781447 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:44.788927 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:44.789458 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:44.790397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:44.790906 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:44.817617 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lazy-loading 'flavor' on Instance uuid f89bc6b5-c488-4237-b3ca-c18adfee49e0 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:44.849505 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:44.850156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:44.856712 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:44.857206 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:44.858014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:44.858595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:45.003053 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:45.011746 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-fddd1eab-2b95-41ef-88f8-dc7d0857103b tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1464 microversion: 2.1 time: 0.167021 Jun 20 12:30:45.012324 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 491/989] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:44 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1464 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:45.061011 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:45.061597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:45.074191 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:45.074658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:45.075553 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:45.075891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:45.118581 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:30:45.523163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b75a574c-d816-4a9a-836c-9cd1694f9e7a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/action" status: 202 len: 0 microversion: 2.20 time: 0.746811 Jun 20 12:30:45.524768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 499/990] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 20 12:30:44 2022] POST /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/action => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:30:45.539107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:45.540674 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:45.555292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:45.555292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:45.555292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:45.555292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:45.580988 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cda5557b-5c8b-46c3-a6ff-bdc79f0407d3 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 204 len: 0 microversion: 2.1 time: 0.524101 Jun 20 12:30:45.582311 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 492/991] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:45 2022] DELETE /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:30:45.593491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:45.594226 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:45.607096 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:45.607557 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:45.608419 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:45.608864 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:45.717980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:45.729472 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:45.731020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:45.732728 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0569a4df-3dbc-4eed-bd13-2ba064cac6b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.202365 Jun 20 12:30:45.733303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 500/992] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:45 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:45.775820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:45.784099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-472393da-5033-4f11-996a-265a4e72cb3e tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1470 microversion: 2.1 time: 0.194763 Jun 20 12:30:45.785568 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 493/993] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:45 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:46.752614 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:46.753199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:46.760814 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.761357 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.762238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.762675 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.803019 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:46.804137 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:46.806181 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:46.814220 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.814677 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.817372 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:46.817372 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:46.912850 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:46.923507 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:46.925610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:46.929488 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-918f2627-bcc5-4490-91ca-494ea78354e0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.180879 Jun 20 12:30:46.941576 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 501/994] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:46 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:46.977642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:46.987404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8e194d66-9009-4925-8eee-85a29a5aadef tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1470 microversion: 2.1 time: 0.188567 Jun 20 12:30:46.993008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 494/995] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:46 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:30:47.526058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-8cf8bdb3-169d-473a-90e3-9fab1234024f req-df529391-a61d-4b94-a62b-1594c2ffc7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4faad293-40eb-47a1-9b27-4822946c3781", "name": "network-vif-deleted", "tag": "39521b1e-a09f-4d7a-88a6-2c7f0ee66a24"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:47.536050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-8cf8bdb3-169d-473a-90e3-9fab1234024f req-df529391-a61d-4b94-a62b-1594c2ffc7b4 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:47.536503 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-8cf8bdb3-169d-473a-90e3-9fab1234024f req-df529391-a61d-4b94-a62b-1594c2ffc7b4 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:47.551275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-8cf8bdb3-169d-473a-90e3-9fab1234024f req-df529391-a61d-4b94-a62b-1594c2ffc7b4 service nova] Creating event network-vif-deleted:39521b1e-a09f-4d7a-88a6-2c7f0ee66a24 for instance 4faad293-40eb-47a1-9b27-4822946c3781 on hv-cinder-83697 Jun 20 12:30:47.556635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-8cf8bdb3-169d-473a-90e3-9fab1234024f req-df529391-a61d-4b94-a62b-1594c2ffc7b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038273 Jun 20 12:30:47.557321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 502/996] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:47.948647 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:47.949612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:47.957428 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:47.960983 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:47.962093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:47.963157 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.007378 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:48.014193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:48.024985 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:48.038803 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.040255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:48.040911 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.081227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:48.082615 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:48.083250 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lazy-loading 'fault' on Instance uuid 4faad293-40eb-47a1-9b27-4822946c3781 {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:48.130932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4fc33384e304e78b36cd36dce23f265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de2f4a6d04b47eeabc252a4802957d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:48.139415 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:48.146839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:48.148372 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-00ae9742-dde1-429d-a9be-332a8c7ea556 tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 200 len: 1304 microversion: 2.1 time: 0.146025 Jun 20 12:30:48.148962 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 503/997] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:48 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:48.154969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:48.157879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:48.157879 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2e456489-92ab-4332-a2af-925ff65ec16f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.213114 Jun 20 12:30:48.158394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 495/998] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:47 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:49.167237 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:49.167860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] [instance: 4faad293-40eb-47a1-9b27-4822946c3781] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:49.174787 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:49.175390 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:49.176704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:49.176974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:49.182800 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:49.183008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:49.184559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:49.185015 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:49.185823 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:49.186295 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:49.190611 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] HTTP exception thrown: Instance 4faad293-40eb-47a1-9b27-4822946c3781 could not be found. Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Request method failure captured: Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 HTTP/1.1 Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGhjnjqOlysPBIvYoZznkTJQROnl1siAQ_Rk5nk_ubDcHVVugxx5ivmhg04UoQEcDKsj6YlNja6Ynmj8br8zChLioXop_MW0NKRbOLg20xqohT-RvH7pbjrrE4NYsRp3xhIAjWgetBHdmsViU8omJo8Rpur8DXnhTpPwoPSdNgYhSrg Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 3de2f4a6d04b47eeabc252a4802957d2 Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-VolumesNegativeTest-1393860601 Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:30:49.192275 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3de2f4a6d04b47eeabc252a4802957d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3de2f4a6d04b47eeabc252a4802957d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3de2f4a6d04b47eeabc252a4802957d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3de2f4a6d04b47eeabc252a4802957d2"}]}] Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-VolumesNegativeTest-1393860601 Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 3de2f4a6d04b47eeabc252a4802957d2 Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-VolumesNegativeTest-1393860601 Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-VolumesNegativeTest-1393860601-project Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: b4fc33384e304e78b36cd36dce23f265 Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-VolumesNegativeTest-1393860601-project Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 4faad293-40eb-47a1-9b27-4822946c3781 could not be found. Jun 20 12:30:49.194099 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '4faad293-40eb-47a1-9b27-4822946c3781'} Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4faad293-40eb-47a1-9b27-4822946c3781 could not be found. Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:49.195063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4faad293-40eb-47a1-9b27-4822946c3781 could not be found. Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4faad293-40eb-47a1-9b27-4822946c3781 could not be found. Jun 20 12:30:49.196638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:30:49.200738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] Returning 404 to user: Instance 4faad293-40eb-47a1-9b27-4822946c3781 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:49.200738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d6d45777-ae3b-44b6-922a-9492001e73ae tempest-VolumesNegativeTest-1393860601 tempest-VolumesNegativeTest-1393860601-project] 10.222.0.64 "GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781" status: 404 len: 111 microversion: 2.1 time: 0.030981 Jun 20 12:30:49.200738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 504/999] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:49 2022] GET /compute/v2.1/servers/4faad293-40eb-47a1-9b27-4822946c3781 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:49.330058 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:49.339184 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:49.340866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:49.341981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-530df8b5-9cc2-4212-ab6a-050c73fd8e6f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.169468 Jun 20 12:30:49.342545 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 496/1000] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:49 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:50.360768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:50.361396 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:50.368649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.369095 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.369895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.370337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.531211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:50.541458 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:50.543789 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:50.545462 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-48361168-1d83-4e14-8f19-6c03a3a566b0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.188815 Jun 20 12:30:50.546475 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 505/1001] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:50 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:50.967581 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:50.968093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:50.978617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.978617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:50.978617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:50.979092 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.008079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:30:51.112670 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-6020ed72-1356-4bb5-979e-4644a3f5515b req-4bdfe88d-365a-4d07-94ef-467178b181df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53262aa-7cf3-44ef-a688-cac5131e08bb", "tag": "65f8231e-4b5e-4ec6-805b-a7feee02eab0"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:51.126948 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-6020ed72-1356-4bb5-979e-4644a3f5515b req-4bdfe88d-365a-4d07-94ef-467178b181df service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.129014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-6020ed72-1356-4bb5-979e-4644a3f5515b req-4bdfe88d-365a-4d07-94ef-467178b181df service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.140628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-6020ed72-1356-4bb5-979e-4644a3f5515b req-4bdfe88d-365a-4d07-94ef-467178b181df service nova] Creating event network-changed:65f8231e-4b5e-4ec6-805b-a7feee02eab0 for instance b53262aa-7cf3-44ef-a688-cac5131e08bb on hv-cinder-83697 Jun 20 12:30:51.147147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-6020ed72-1356-4bb5-979e-4644a3f5515b req-4bdfe88d-365a-4d07-94ef-467178b181df service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186683 Jun 20 12:30:51.148266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 506/1002] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:51.387201 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-448b46ca-de2e-48ce-89b4-6ddde42716f5 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 204 len: 0 microversion: 2.1 time: 0.430895 Jun 20 12:30:51.391623 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 497/1003] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:30:50 2022] DELETE /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:30:51.399538 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:51.401510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:51.410927 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.411692 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.412591 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.414714 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.567392 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:51.568211 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:51.574888 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.575467 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.576458 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:51.577357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:51.752981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:51.765335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:51.767499 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:51.769127 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-298a62a0-1a96-41da-9465-cd8b3351164d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.206946 Jun 20 12:30:51.770362 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 498/1004] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:51 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:30:51.805933 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:51.814607 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-555871d7-96e2-44a0-985d-2bb52ee30c6d tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.421697 Jun 20 12:30:51.815183 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 507/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:51 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:52.788524 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:52.789135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:52.796199 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:52.796653 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:52.797434 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:52.799617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:52.835695 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:52.837451 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:52.845184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:52.845625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:52.846438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:52.846878 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:52.972959 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:52.979484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:52.981032 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:52.982225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-21230422-1ee3-4075-a625-ac2c183f7497 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.197794 Jun 20 12:30:52.982788 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 499/1006] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:52 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:53.052613 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:53.060952 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-66c5a9ff-f526-4cab-9685-5a67a15a99fd tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1568 microversion: 2.1 time: 0.231648 Jun 20 12:30:53.061560 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 508/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:52 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:53.658555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-639f106a-d511-455a-b5b7-ba614db5708e req-219e4cc2-81cf-41d3-a740-0100fba722b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53262aa-7cf3-44ef-a688-cac5131e08bb", "name": "network-vif-deleted", "tag": "65f8231e-4b5e-4ec6-805b-a7feee02eab0"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:30:53.667409 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-639f106a-d511-455a-b5b7-ba614db5708e req-219e4cc2-81cf-41d3-a740-0100fba722b3 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:53.668404 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-639f106a-d511-455a-b5b7-ba614db5708e req-219e4cc2-81cf-41d3-a740-0100fba722b3 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:53.679595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-639f106a-d511-455a-b5b7-ba614db5708e req-219e4cc2-81cf-41d3-a740-0100fba722b3 service nova] Creating event network-vif-deleted:65f8231e-4b5e-4ec6-805b-a7feee02eab0 for instance b53262aa-7cf3-44ef-a688-cac5131e08bb on hv-cinder-83697 Jun 20 12:30:53.684678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-639f106a-d511-455a-b5b7-ba614db5708e req-219e4cc2-81cf-41d3-a740-0100fba722b3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 Jun 20 12:30:53.685300 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 500/1008] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:30:54.002124 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:54.005068 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:54.013651 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:54.014343 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:54.015203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:54.015712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:54.082891 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:54.083714 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:54.093708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:54.094194 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:54.094980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:54.095421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:54.170049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:54.180473 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-32b57f9e-40c6-4423-8352-e25634fa9030 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1220 microversion: 2.1 time: 0.102685 Jun 20 12:30:54.181433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 501/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:54 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:54.203112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:54.212549 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:54.214428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:54.216002 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-41dadd39-d55d-479f-a718-b05fa6c95f12 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.217852 Jun 20 12:30:54.236178 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 509/1010] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:53 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:55.200052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:55.200608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:55.207926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.208372 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.209130 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.209564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.235437 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:55.236084 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:55.243454 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.243904 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.244707 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.245147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.247952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:55.248400 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:55.248956 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lazy-loading 'fault' on Instance uuid b53262aa-7cf3-44ef-a688-cac5131e08bb {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:30:55.290857 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85d4be423d794100ac5b00d32fb5620c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae372a6537684625acb82b36862bde25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:55.299106 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-42d99bdc-06c7-4796-9582-1a68848b323e tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 200 len: 1225 microversion: 2.1 time: 0.103146 Jun 20 12:30:55.299693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 502/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:55 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:30:55.388112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:55.396297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:55.397750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:55.398953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ff2665eb-e444-4e34-924d-b49098c27ceb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.167503 Jun 20 12:30:55.399517 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 510/1012] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:55 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:30:56.317763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:56.319068 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] [instance: b53262aa-7cf3-44ef-a688-cac5131e08bb] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:56.326213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.326733 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:56.327634 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.328091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:56.331543 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:56.346225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] HTTP exception thrown: Instance b53262aa-7cf3-44ef-a688-cac5131e08bb could not be found. Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Request method failure captured: Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb HTTP/1.1 Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGcfyCA8VhBTGeDtXHlTi0NktSxZ3z5kT0JuoSuQqmfs3Gc_YgD7APMLKdR0-WEUTGZmSohn6DjeNYVGYtIyPoWia414F9NQcT6bQKfqf7uidrdV2KReLRCyoVHS-qs6gCPcRn7kIsWTgFK7CPs9SvH9te4gRRvfS1G0tm5FIbDxJFM Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: ae372a6537684625acb82b36862bde25 Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-TestShelveInstance-1348572302 Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:30:56.348483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae372a6537684625acb82b36862bde25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae372a6537684625acb82b36862bde25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae372a6537684625acb82b36862bde25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae372a6537684625acb82b36862bde25"}]}] Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-TestShelveInstance-1348572302 Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: ae372a6537684625acb82b36862bde25 Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-TestShelveInstance-1348572302 Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-TestShelveInstance-1348572302-project Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 85d4be423d794100ac5b00d32fb5620c Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-TestShelveInstance-1348572302-project Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance b53262aa-7cf3-44ef-a688-cac5131e08bb could not be found. Jun 20 12:30:56.350009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'b53262aa-7cf3-44ef-a688-cac5131e08bb'} Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53262aa-7cf3-44ef-a688-cac5131e08bb could not be found. Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:30:56.351427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53262aa-7cf3-44ef-a688-cac5131e08bb could not be found. Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53262aa-7cf3-44ef-a688-cac5131e08bb could not be found. Jun 20 12:30:56.353142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:30:56.354583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Returning 404 to user: Instance b53262aa-7cf3-44ef-a688-cac5131e08bb could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:30:56.354583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-be709304-16b4-412d-89a4-5df681b63406 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb" status: 404 len: 111 microversion: 2.1 time: 0.037102 Jun 20 12:30:56.354583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 503/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:30:56 2022] GET /compute/v2.1/servers/b53262aa-7cf3-44ef-a688-cac5131e08bb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:56.421130 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:56.424089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:56.432153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.432601 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:56.433404 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:56.433869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:56.598374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:56.609054 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:56.610643 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:56.611851 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7f2ea534-7a6c-4900-97b2-b7cfa1b7db45 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.197683 Jun 20 12:30:56.612403 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 511/1014] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:56 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:30:56.679059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-df3facfd-b2b8-4994-8e77-fa9aaf15c9b4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] Calling method '.version_select at 0x7fe290dfeca0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:56.805967 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-df3facfd-b2b8-4994-8e77-fa9aaf15c9b4 tempest-TestShelveInstance-1348572302 tempest-TestShelveInstance-1348572302-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1801647061" status: 202 len: 0 microversion: 2.1 time: 0.131992 Jun 20 12:30:56.812658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 504/1015] 10.222.0.64 () {58 vars in 1253 bytes} [Mon Jun 20 12:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1801647061 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 12:30:57.633178 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:57.633905 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:57.640900 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:57.641070 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:57.641928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:57.642395 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:57.887852 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:57.896191 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:57.898194 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:57.899409 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3a918d2d-f651-4ced-9e2a-29ea705abb4f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.272055 Jun 20 12:30:57.926707 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 512/1016] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:57 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:30:58.936882 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:30:58.937515 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:30:58.945388 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:58.945867 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:58.946909 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:30:58.947558 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:30:59.180828 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:59.189125 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:59.190709 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:30:59.192353 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-38bbeb23-1571-4049-9a7c-5850796fbf96 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.260165 Jun 20 12:30:59.193100 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 505/1017] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:30:58 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:00.211318 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:00.211937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:00.219193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.219649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.220428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:00.220860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:00.396196 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:00.404407 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:00.405993 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:00.407232 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-71ef4f7d-afba-4eb0-a067-e628bf113d66 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.200956 Jun 20 12:31:00.407797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 513/1018] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:00 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:01.425204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:01.426739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:01.432962 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.433429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.434215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:01.434654 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:01.563968 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:01.573114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:01.588381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:01.588381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-be4206bb-8536-4cbb-8209-64b47c2c85ca tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.154613 Jun 20 12:31:01.588381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 506/1019] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:01 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:02.594242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:02.595449 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:02.603438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:02.604144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:02.605082 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:02.605678 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:02.832735 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:02.840624 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:02.843786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:02.843786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ae4100d0-95d0-4473-a252-5ef29676328d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.253189 Jun 20 12:31:02.854024 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 514/1020] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:02 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:03.861671 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:03.862870 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:03.872284 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:03.872739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:03.874917 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:03.874917 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:04.026884 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:04.038814 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:04.040873 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:04.041944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-633018ca-a6e9-447e-abd2-82c776275323 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.184309 Jun 20 12:31:04.052430 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 507/1021] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:03 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:05.061877 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:05.063170 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:05.069065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=52 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:05.070960 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:05.071609 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:05.072565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:05.073248 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:05.230704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:05.238837 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:05.240408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:05.241578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f342d08e-853c-4c65-8ee4-79c40ccaf386 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.183641 Jun 20 12:31:05.242361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 515/1022] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:05 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:06.261537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:06.262186 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:06.268822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.269275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.270820 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:06.271401 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:06.468177 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:06.477459 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:06.479125 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:06.480601 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-dd2f4d93-cf57-43ba-a463-51f380b3e042 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.223282 Jun 20 12:31:06.481399 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 508/1023] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:06 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:07.499509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:07.500123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:07.507372 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:07.507822 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:07.508585 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:07.509020 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:07.640844 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:07.649236 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:07.650793 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:07.651956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b58dbeec-8293-43a7-b4db-daed77be1f4e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1741 microversion: 2.20 time: 0.156378 Jun 20 12:31:07.652518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 516/1024] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:07 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:08.671750 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:08.672371 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:08.679984 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:08.680439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:08.681223 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:08.681667 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:08.814225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:08.822455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:08.824027 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:08.825197 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b9891d86-2db7-4415-b1e5-587135af5085 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1741 microversion: 2.20 time: 0.157832 Jun 20 12:31:08.825757 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 509/1025] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:08 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:09.845291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:09.846579 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:09.853441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:09.854188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:09.855430 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:09.856175 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:09.994671 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:10.002906 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:10.004860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:10.006336 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4a252b9d-7ca6-4914-94fc-3a15015a80b4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.165482 Jun 20 12:31:10.007027 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 517/1026] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:09 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:11.025510 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:11.026322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:11.033224 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:11.033681 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:11.034628 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:11.035456 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:11.188196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:11.196963 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:11.198822 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:11.200222 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8767021c-f0c6-416d-90cc-e058bff7b910 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.178669 Jun 20 12:31:11.200772 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 510/1027] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:11 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:11.657751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-1075ba22-ba5f-48ca-a6f4-5ecb52a715ab req-fd43dd94-b0f3-4ef8-b414-ab4773056e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89bc6b5-c488-4237-b3ca-c18adfee49e0", "name": "network-vif-plugged", "status": "completed", "tag": "4a2773eb-9f13-4624-b153-cc5009b4ecd3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:11.668397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-1075ba22-ba5f-48ca-a6f4-5ecb52a715ab req-fd43dd94-b0f3-4ef8-b414-ab4773056e57 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:11.669078 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-1075ba22-ba5f-48ca-a6f4-5ecb52a715ab req-fd43dd94-b0f3-4ef8-b414-ab4773056e57 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:11.681926 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-1075ba22-ba5f-48ca-a6f4-5ecb52a715ab req-fd43dd94-b0f3-4ef8-b414-ab4773056e57 service nova] Creating event network-vif-plugged:4a2773eb-9f13-4624-b153-cc5009b4ecd3 for instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 on hv-cinder-83697 Jun 20 12:31:11.687589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-1075ba22-ba5f-48ca-a6f4-5ecb52a715ab req-fd43dd94-b0f3-4ef8-b414-ab4773056e57 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033863 Jun 20 12:31:11.690531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 518/1028] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:12.241621 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:12.243417 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:12.254119 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:12.254885 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:12.255766 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:12.256373 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:12.439693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:12.477835 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:12.483483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:12.484696 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7d5661c4-9cab-4ea6-91f7-8db44406df35 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.267624 Jun 20 12:31:12.485249 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 511/1029] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:12 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:13.505280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:13.505933 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:13.512297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:13.517085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:13.517085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:13.517085 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:13.656045 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:13.664095 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:13.665646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:13.666835 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-10ece7e1-5743-4ac2-a1f1-025c01a5a9d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.166800 Jun 20 12:31:13.667387 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 519/1030] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:13 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:14.685956 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:14.686574 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:14.695627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:14.698093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:14.698093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:14.698093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:14.853918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:14.863041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:14.865092 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:14.866638 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e32bb013-4cd3-4144-a662-88815f044b54 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.184556 Jun 20 12:31:14.875886 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 512/1031] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:14 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:15.886663 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:15.887349 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:15.900776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:15.901367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:15.902290 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:15.902790 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:16.074241 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:16.087531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:16.089188 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:16.090472 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a0613299-d1f9-464d-b69d-e51fcf85f1e6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.208496 Jun 20 12:31:16.091620 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 520/1032] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:15 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:17.108562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:17.109200 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:17.116041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:17.116575 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:17.119002 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:17.119002 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:17.266195 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:17.279439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:17.281320 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:17.282929 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-022f9b45-f4ca-4757-9514-066dc6b05d34 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.178383 Jun 20 12:31:17.284000 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 513/1033] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:17 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:18.302207 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:18.303710 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:18.312605 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:18.313175 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:18.314402 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:18.314857 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:18.489455 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:18.502354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:18.505104 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:18.506129 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f30507e9-b6b7-47ae-8bce-d1f494bde9d2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.208380 Jun 20 12:31:18.506689 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 521/1034] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:18 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:19.528866 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:19.529569 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:19.536257 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:19.538264 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:19.538880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:19.539878 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:19.540941 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:19.687887 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:19.697700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:19.699484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:19.700736 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-be900dd0-7feb-45db-9cd7-b2342a3c39ce tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.176129 Jun 20 12:31:19.701319 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 514/1035] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:19 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:20.720716 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:20.721334 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:20.729527 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:20.730370 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:20.731433 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:20.732107 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:20.736874 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=98 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:20.877355 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:20.886430 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:20.888082 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:20.889521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-603c204d-22b8-479a-a1e5-1862110d374f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.172909 Jun 20 12:31:20.901367 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 522/1036] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:20 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:21.908894 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:21.909506 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:21.917128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:21.917583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:21.918718 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:21.919168 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:22.062010 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:22.070878 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:22.072443 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:22.073933 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b7fed32e-1b95-488a-8b52-344480ad60b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1736 microversion: 2.20 time: 0.168946 Jun 20 12:31:22.074497 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 515/1037] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:21 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:23.092443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:23.092988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:23.099630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:23.100106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:23.100870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:23.101322 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:23.235087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:23.243857 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:23.245395 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:23.246565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-79ee3255-de91-4daa-872c-a6cc6c1d2ab4 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1718 microversion: 2.20 time: 0.158359 Jun 20 12:31:23.247217 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 523/1038] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:23 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:24.266618 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:24.267232 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:24.274118 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:24.274567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:24.275340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:24.275778 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:24.410679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:24.418708 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:24.420259 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:24.421446 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3d2ae32c-3aad-4131-b3fe-91566a3d782b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1718 microversion: 2.20 time: 0.159704 Jun 20 12:31:24.422025 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 516/1039] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:24 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:25.440080 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:25.440610 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:25.448372 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:25.448819 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:25.449583 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:25.450065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:25.592768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:25.602100 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:25.603712 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:25.604864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7e9a6e48-75a4-4e17-8a15-ae9e4fdf4a2e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1661 microversion: 2.20 time: 0.168848 Jun 20 12:31:25.605412 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 524/1040] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:25 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1661 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:25.622944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a4287ed2-164f-443b-a651-b9ee78f87e7b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a8a207d-a8b1-46ac-98b6-8ffab82e675e"}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:25.624093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a4287ed2-164f-443b-a651-b9ee78f87e7b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:25.631969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a4287ed2-164f-443b-a651-b9ee78f87e7b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:25.632505 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a4287ed2-164f-443b-a651-b9ee78f87e7b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:25.633468 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a4287ed2-164f-443b-a651-b9ee78f87e7b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:25.633954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a4287ed2-164f-443b-a651-b9ee78f87e7b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:25.652834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-18475968-4d5e-48d7-a804-fbfa9a247516 req-6efdddc8-3bc6-40db-b910-d4f4902c8e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89bc6b5-c488-4237-b3ca-c18adfee49e0", "name": "network-vif-unplugged", "status": "completed", "tag": "4a2773eb-9f13-4624-b153-cc5009b4ecd3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:25.662089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-18475968-4d5e-48d7-a804-fbfa9a247516 req-6efdddc8-3bc6-40db-b910-d4f4902c8e0a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:25.662536 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-18475968-4d5e-48d7-a804-fbfa9a247516 req-6efdddc8-3bc6-40db-b910-d4f4902c8e0a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:25.674636 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.compute.server_external_events [req-18475968-4d5e-48d7-a804-fbfa9a247516 req-6efdddc8-3bc6-40db-b910-d4f4902c8e0a service nova] Unable to find a host for instance f89bc6b5-c488-4237-b3ca-c18adfee49e0. Dropping event network-vif-unplugged {{(pid=118092) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 12:31:25.675625 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-18475968-4d5e-48d7-a804-fbfa9a247516 req-6efdddc8-3bc6-40db-b910-d4f4902c8e0a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027202 Jun 20 12:31:25.676748 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 525/1041] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 20 12:31:26.770083 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a4287ed2-164f-443b-a651-b9ee78f87e7b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.150666 Jun 20 12:31:26.770754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 517/1042] 10.222.0.64 () {62 vars in 1363 bytes} [Mon Jun 20 12:31:25 2022] POST /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments => generated 188 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:31:26.889408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-215c2c2b-626c-4201-91b2-4c0461e21636 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:26.893616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-215c2c2b-626c-4201-91b2-4c0461e21636 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:26.897518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-215c2c2b-626c-4201-91b2-4c0461e21636 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:26.898004 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-215c2c2b-626c-4201-91b2-4c0461e21636 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:26.898810 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-215c2c2b-626c-4201-91b2-4c0461e21636 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:26.899242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-215c2c2b-626c-4201-91b2-4c0461e21636 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:27.138247 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-215c2c2b-626c-4201-91b2-4c0461e21636 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/action" status: 202 len: 0 microversion: 2.20 time: 0.252774 Jun 20 12:31:27.138864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 526/1043] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 20 12:31:26 2022] POST /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:31:27.152764 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:27.153020 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:27.160213 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:27.160810 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:27.161778 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:27.162262 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:27.346063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:27.353063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:27.356372 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:27.358087 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:27.359341 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0ea3ac13-145f-4ad8-9f4f-b057498aa5ae tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1747 microversion: 2.20 time: 0.211072 Jun 20 12:31:27.360045 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 518/1044] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:27 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1747 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:31:28.379564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:28.380173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:28.386786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:28.395438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:28.395438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:28.395438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:28.528438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:28.537535 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:28.539273 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:28.540447 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-cd04c040-4ab5-4d09-8959-01378c5e1cd7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1747 microversion: 2.20 time: 0.165947 Jun 20 12:31:28.541168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 527/1045] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:28 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:29.560017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:29.560635 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:29.568541 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:29.568987 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:29.569754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:29.570217 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:29.749537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:29.758859 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:29.760409 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:29.761563 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-173b7f0f-5f77-4993-b290-b05d842e4288 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1749 microversion: 2.20 time: 0.205509 Jun 20 12:31:29.762142 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 519/1046] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:29 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1749 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:31:30.781171 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:30.785471 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:30.789902 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:30.790363 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:30.791142 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:30.791585 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:30.999395 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:31.009600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:31.011193 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:31.014167 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8dd46e3c-fe61-44b4-aa78-d430d4b51f87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.235796 Jun 20 12:31:31.014167 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 528/1047] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:30 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:32.031305 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:32.032679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:32.040491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:32.040954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:32.041787 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:32.042256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:32.198700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:32.208392 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:32.210292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:32.211581 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4da31a65-df95-4660-87fc-469416e168a9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.184827 Jun 20 12:31:32.212632 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 520/1048] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:32 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:33.230685 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:33.231214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:33.238671 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:33.239619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:33.240722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:33.241408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:33.391649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:33.403014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:33.405821 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:33.409348 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d21cd089-c439-4fa8-9ba8-92aec79e6014 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.183040 Jun 20 12:31:33.412501 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 529/1049] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:33 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:34.428714 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:34.429334 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:34.436026 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:34.436484 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:34.437324 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:34.437709 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:34.796676 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:34.806099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:34.807657 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:34.808839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d1977f0a-b4db-4c04-abb5-94ae58c78ff5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.384256 Jun 20 12:31:34.809406 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 521/1050] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:34 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:35.830826 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:35.830826 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:35.833376 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=32 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:35.838592 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:35.839049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:35.839834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:35.840298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:35.981091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:36.000699 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:36.002307 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:36.003477 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2bdeac8e-a53c-4385-84fb-5ef56df3364f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.178685 Jun 20 12:31:36.014103 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 530/1051] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:35 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:37.022759 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:37.023403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:37.030253 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:37.030788 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:37.031654 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:37.032097 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:37.180700 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:37.189395 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:37.191028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:37.192242 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-40a9d280-9860-400d-87b5-e522fc5bf333 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.174320 Jun 20 12:31:37.192801 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 522/1052] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:37 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:38.211242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:38.211859 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:38.218816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:38.219274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:38.220057 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:38.220494 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:38.363423 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:38.373068 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:38.374863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:38.376427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-36426c6b-9bef-43c4-b186-b28424cbed3c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.169323 Jun 20 12:31:38.377393 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 531/1053] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:38 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:39.400321 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:39.401103 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:39.408153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:39.408617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:39.409606 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:39.410072 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:39.557401 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:39.566617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:39.569060 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:39.570278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-298e52f5-46ae-4106-97d6-e053b603f58a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.174078 Jun 20 12:31:39.573590 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 523/1054] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:39 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:40.589410 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:40.590057 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:40.596425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:40.596870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:40.597616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:40.598079 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:40.729453 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:40.737949 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:40.739691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:40.740854 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6ccfb293-37f0-4fc4-920d-60b56445efe8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.155395 Jun 20 12:31:40.741411 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 532/1055] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:40 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:41.758851 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:41.759473 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:41.765902 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:41.766350 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:41.767112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:41.767549 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:41.895832 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:41.904463 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:41.906040 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:41.907187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5e885a07-38ba-4690-9f6a-7542348333ef tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.152500 Jun 20 12:31:41.907736 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 524/1056] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:41 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:42.926264 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:42.927743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:42.933919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:42.934365 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:42.935126 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:42.935557 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:43.067292 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:43.076254 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:43.077815 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:43.078988 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-780503cc-03c0-4b68-9b7e-193be00a2b87 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.156887 Jun 20 12:31:43.079547 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 533/1057] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:42 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:44.097192 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:44.097828 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:44.104735 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:44.105179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:44.105972 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:44.106405 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:44.238332 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:44.247454 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:44.253642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:44.253642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-2f324e7e-54c9-4186-abb8-100256ccd02f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.156923 Jun 20 12:31:44.253642 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 525/1058] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:44 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:45.268784 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:45.269438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:45.280402 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:45.280859 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:45.281644 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:45.283540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:45.427269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:45.436775 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:45.438567 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:45.439983 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e8d24448-e83f-4ede-adc1-fb138b5d4340 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.175259 Jun 20 12:31:45.440638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 534/1059] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:45 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:46.461586 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:46.462228 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:46.468992 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:46.469441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:46.470260 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:46.470692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:46.603907 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:46.610222 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:46.611788 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:46.612944 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-897eed6e-96a2-46b9-aa91-6ca468aa86c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.156250 Jun 20 12:31:46.613535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 526/1060] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:46 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:47.631664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:47.632303 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:47.638939 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:47.639385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:47.640148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:47.640582 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:47.774274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:47.782807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:47.784419 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:47.785616 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-31e28f98-3c6f-4ccb-8e86-0a38d2ff8f82 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.158247 Jun 20 12:31:47.786975 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 535/1061] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:47 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:48.806511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:48.807135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:48.813689 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:48.818208 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:48.818208 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:48.818208 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:48.947327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:48.955723 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:48.957347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:48.958587 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-10f25b09-0d56-463c-9fc2-49e50f85da16 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.156053 Jun 20 12:31:48.959189 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 527/1062] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:48 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:49.978922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:49.979532 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:49.986021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.986470 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:49.987230 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:49.987665 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:50.123241 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:50.132721 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:50.134301 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:50.135520 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-de2a183f-4521-4c77-8a02-f5e6fb9152d1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.160468 Jun 20 12:31:50.136316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 536/1063] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:49 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:51.153232 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:51.154006 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:51.160297 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.160741 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.161670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.162108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.298363 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:51.307602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:51.314077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:51.314077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9cc86189-4035-41bc-9073-77d0b4598576 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.161139 Jun 20 12:31:51.314077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 528/1064] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:51 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:51.765822 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-a509fcf1-bcd4-415b-9bbd-9221350cb91e req-7f60eedc-8ee5-4043-a004-5bcbd031a701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89bc6b5-c488-4237-b3ca-c18adfee49e0", "name": "network-vif-plugged", "status": "completed", "tag": "4a2773eb-9f13-4624-b153-cc5009b4ecd3"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:31:51.774666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-a509fcf1-bcd4-415b-9bbd-9221350cb91e req-7f60eedc-8ee5-4043-a004-5bcbd031a701 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:51.775112 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-a509fcf1-bcd4-415b-9bbd-9221350cb91e req-7f60eedc-8ee5-4043-a004-5bcbd031a701 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:51.778869 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:51.785715 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-a509fcf1-bcd4-415b-9bbd-9221350cb91e req-7f60eedc-8ee5-4043-a004-5bcbd031a701 service nova] Creating event network-vif-plugged:4a2773eb-9f13-4624-b153-cc5009b4ecd3 for instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 on hv-cinder-83697 Jun 20 12:31:51.791012 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-a509fcf1-bcd4-415b-9bbd-9221350cb91e req-7f60eedc-8ee5-4043-a004-5bcbd031a701 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028894 Jun 20 12:31:51.791548 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 537/1065] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:31:52.331538 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:52.331918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:52.336108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=30 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:52.339658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:52.340317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:52.341102 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:52.341608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:52.479509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:52.488059 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:52.489662 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:52.495931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9d6ac8de-1a29-47dc-84bc-20d92f71070d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.163912 Jun 20 12:31:52.496573 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 529/1066] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:52 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:53.520110 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:53.520627 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:53.528516 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:53.528966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:53.529946 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:53.530557 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:53.668332 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:53.680163 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:53.683127 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:53.684811 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a2f4777d-36cb-424d-a2c4-547d541ee3cb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.168975 Jun 20 12:31:53.685478 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 538/1067] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:53 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:54.704396 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:54.705187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:54.712379 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:54.712867 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:54.713745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:54.714246 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:54.867283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:54.878208 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:54.880413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:54.882015 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-dd431036-9d15-402c-b1d7-c96d5f458c52 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1805 microversion: 2.20 time: 0.181611 Jun 20 12:31:54.882780 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 530/1068] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:54 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1805 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:31:55.901565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:31:55.902195 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:31:55.908978 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:55.909420 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:55.910273 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:31:55.910700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:31:56.042653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:56.051467 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:56.053238 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:31:56.054454 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-378d959c-5d13-4ff8-855e-b452f340b473 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1792 microversion: 2.20 time: 0.157938 Jun 20 12:31:56.055559 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 539/1069] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:31:55 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1792 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:18.358090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1790239806", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1645848315", "security_groups": [{"name": "tempest-secgroup-smoke-2047174386"}], "block_device_mapping_v2": [{"uuid": "26d80012-fce1-4d90-8597-b99e5dd61b31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7bf56be-1d96-4e0f-a5ab-753fc0e58582"}]}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:18.366947 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=3 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:18.367608 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=73 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:18.469727 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] validate_networks() for [('f7bf56be-1d96-4e0f-a5ab-753fc0e58582', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:32:18.831399 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:32:18.831831 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:32:18.832342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:32:18.832785 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:32:18.833204 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:32:18.842248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:18.842701 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:18.843510 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:18.843952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:18.861543 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:32:18.865483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Getting quotas for user 648c1ba14f1842a5b4160a7569e3206e and project 68f8e01a266c4737ad5fa510ed9b2fad. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:32:18.921839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:32:18.923989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26d80012-fce1-4d90-8597-b99e5dd61b31',volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:32:19.314447 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6b81546f-5fdb-4c5b-a0c2-0a8b4431b593 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.961093 Jun 20 12:32:19.315108 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 531/1070] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 20 12:32:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 12:32:19.324976 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7b5b16c8-9e4d-44d4-ba55-cc33c8faae42 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:19.331032 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7b5b16c8-9e4d-44d4-ba55-cc33c8faae42 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:19.331032 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=19 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:19.331032 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=13 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:19.380846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-7b5b16c8-9e4d-44d4-ba55-cc33c8faae42 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:19.387751 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7b5b16c8-9e4d-44d4-ba55-cc33c8faae42 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1095 microversion: 2.1 time: 0.066675 Jun 20 12:32:19.388691 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 540/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:19 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:20.404843 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:20.405450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:20.412095 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:20.412540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:20.413302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:20.413736 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:20.485660 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:20.493159 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-715939a4-de44-4780-8eeb-43f73a496843 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1137 microversion: 2.1 time: 0.093127 Jun 20 12:32:20.493718 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 532/1072] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:20 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:21.512103 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:21.512982 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:21.520109 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:21.520557 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:21.521418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:21.521951 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:21.592169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:21.599585 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-f98d33e8-6bd9-409f-92a4-8f72c97a0f1d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1211 microversion: 2.1 time: 0.092499 Jun 20 12:32:21.600152 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 541/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:21 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:22.616438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:22.617083 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:22.624217 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:22.624669 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:22.625455 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:22.625929 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:22.758504 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:22.768077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8028e1ba-d16a-4d82-a074-8b22e68e97f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.155451 Jun 20 12:32:22.768651 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 533/1074] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:22 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:23.180704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-3275a0db-9da3-414e-9a2b-b8aeab643148 req-818abf38-0a40-484c-86a3-cc90734c66fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcac7a1b-19f1-4b18-b565-61b66a9dbbcc", "tag": "d74276b7-9da3-4f54-819c-7668b2bca69b"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:23.194734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-3275a0db-9da3-414e-9a2b-b8aeab643148 req-818abf38-0a40-484c-86a3-cc90734c66fe service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:23.195387 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-3275a0db-9da3-414e-9a2b-b8aeab643148 req-818abf38-0a40-484c-86a3-cc90734c66fe service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:23.211373 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-3275a0db-9da3-414e-9a2b-b8aeab643148 req-818abf38-0a40-484c-86a3-cc90734c66fe service nova] Creating event network-changed:d74276b7-9da3-4f54-819c-7668b2bca69b for instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc on hv-cinder-83697 Jun 20 12:32:23.217482 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-3275a0db-9da3-414e-9a2b-b8aeab643148 req-818abf38-0a40-484c-86a3-cc90734c66fe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040836 Jun 20 12:32:23.218117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 542/1075] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:23.786324 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:23.787083 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:23.795041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:23.795492 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:23.796270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:23.796706 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:23.932214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:23.939970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5a856957-c7b2-471a-a555-0020bf401914 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.157515 Jun 20 12:32:23.940537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 534/1076] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:23 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:24.958555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:24.959257 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:24.965635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:24.966122 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:24.966890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:24.967328 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:25.100630 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:25.109033 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-989dc684-13e4-49bd-ab8c-aa1c729e8331 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.155229 Jun 20 12:32:25.109594 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 543/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:24 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:26.126266 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:26.126877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:26.133238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:26.133756 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:26.134577 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:26.134953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:26.270760 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:26.278214 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c070e34b-e646-45cd-b3a4-88c50158f2a8 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.155897 Jun 20 12:32:26.279008 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 535/1078] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:26 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:27.295102 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:27.295717 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:27.302406 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:27.302860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:27.303628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:27.304070 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:27.436798 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:27.444379 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-4b6ce3d2-1ada-4a14-8245-60aa2546d97f tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.153877 Jun 20 12:32:27.444950 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 544/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:27 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:28.461613 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:28.462399 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:28.470149 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:28.470592 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:28.471355 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:28.471786 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:28.602670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:28.612676 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ec6b4a97-31f4-4f8c-8909-9759db6ecd16 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.154859 Jun 20 12:32:28.613250 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 536/1080] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:28 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:28.920515 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-716bcdce-da1d-4326-bdb6-33e7f6983fd1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:28.921050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-716bcdce-da1d-4326-bdb6-33e7f6983fd1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:28.927506 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-716bcdce-da1d-4326-bdb6-33e7f6983fd1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:28.931062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-716bcdce-da1d-4326-bdb6-33e7f6983fd1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:28.931062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-716bcdce-da1d-4326-bdb6-33e7f6983fd1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:28.931062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-716bcdce-da1d-4326-bdb6-33e7f6983fd1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:28.959767 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-716bcdce-da1d-4326-bdb6-33e7f6983fd1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments/6a8a207d-a8b1-46ac-98b6-8ffab82e675e" status: 200 len: 194 microversion: 2.20 time: 0.043946 Jun 20 12:32:28.960384 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 545/1081] 10.222.0.64 () {60 vars in 1453 bytes} [Mon Jun 20 12:32:28 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments/6a8a207d-a8b1-46ac-98b6-8ffab82e675e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:32:29.022308 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:29.022800 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:29.024591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:29.025250 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=6 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:29.030593 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.031038 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.031857 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.032289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.112954 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lazy-loading 'services' on Instance uuid f89bc6b5-c488-4237-b3ca-c18adfee49e0 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:32:29.346480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-18822970-eb8f-41ff-9522-789c4e1bd93a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments/6a8a207d-a8b1-46ac-98b6-8ffab82e675e" status: 202 len: 0 microversion: 2.20 time: 0.327947 Jun 20 12:32:29.347077 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 537/1082] 10.222.0.64 () {60 vars in 1456 bytes} [Mon Jun 20 12:32:29 2022] DELETE /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments/6a8a207d-a8b1-46ac-98b6-8ffab82e675e => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:32:29.356504 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c3801c0b-92e4-4e56-adbc-459f6b886748 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:29.357690 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c3801c0b-92e4-4e56-adbc-459f6b886748 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:29.363943 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3801c0b-92e4-4e56-adbc-459f6b886748 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.364396 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3801c0b-92e4-4e56-adbc-459f6b886748 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.365194 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3801c0b-92e4-4e56-adbc-459f6b886748 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.365635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c3801c0b-92e4-4e56-adbc-459f6b886748 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.385740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:29.396408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c3801c0b-92e4-4e56-adbc-459f6b886748 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044695 Jun 20 12:32:29.396966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 546/1083] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 20 12:32:29 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:32:29.630530 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:29.631229 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:29.638151 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.638601 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.639370 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:29.639815 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:29.772568 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:29.781056 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-7fe851c1-206c-41d3-80d3-9f86d2b7f6a3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.154831 Jun 20 12:32:29.781625 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 538/1084] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:29 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:30.409619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8acf0aff-a0a5-4cbc-95c5-5c1196596b8a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:30.410153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8acf0aff-a0a5-4cbc-95c5-5c1196596b8a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:30.416643 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8acf0aff-a0a5-4cbc-95c5-5c1196596b8a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.419132 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8acf0aff-a0a5-4cbc-95c5-5c1196596b8a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.419132 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8acf0aff-a0a5-4cbc-95c5-5c1196596b8a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.419132 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8acf0aff-a0a5-4cbc-95c5-5c1196596b8a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.450996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8acf0aff-a0a5-4cbc-95c5-5c1196596b8a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045112 Jun 20 12:32:30.451551 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 547/1085] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 20 12:32:30 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:32:30.797714 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:30.798380 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:30.805062 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.805515 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.806316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:30.806754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:30.940043 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:30.947766 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9cf21542-48e0-4726-abad-e7609eaf02ee tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.154788 Jun 20 12:32:30.948446 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 539/1086] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:30 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:31.462747 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6344a64d-f655-43ba-8546-f1267474b4ac tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:31.463587 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6344a64d-f655-43ba-8546-f1267474b4ac tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:31.470907 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6344a64d-f655-43ba-8546-f1267474b4ac tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.471359 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6344a64d-f655-43ba-8546-f1267474b4ac tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.472123 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6344a64d-f655-43ba-8546-f1267474b4ac tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.472569 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6344a64d-f655-43ba-8546-f1267474b4ac tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.500864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6344a64d-f655-43ba-8546-f1267474b4ac tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042317 Jun 20 12:32:31.501408 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 548/1087] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 20 12:32:31 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:31.557739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:31.558281 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:31.564343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.564793 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.565561 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.566030 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.590908 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:32:31.827243 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3701dad2-266f-4324-88dc-df709531f839 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 204 len: 0 microversion: 2.20 time: 0.273058 Jun 20 12:32:31.828165 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 540/1088] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 20 12:32:31 2022] DELETE /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:32:31.836443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:31.837343 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:31.843550 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.843996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.844766 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.845199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.965559 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:31.966952 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:31.974596 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.975337 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.976147 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:31.976634 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:31.980776 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:31.989633 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:31.991575 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:31.992965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6e9c540e-821a-4fc2-a7bd-2280b5717cd8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.160576 Jun 20 12:32:31.997892 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 549/1089] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:31 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:32.112877 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:32.121173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-225e7b5b-b3c6-4231-a7f0-7692b945704d tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.160357 Jun 20 12:32:32.122522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 541/1090] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:31 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:33.012476 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:33.013068 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:33.019309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:33.019759 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:33.020525 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:33.020966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:33.138894 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:33.139509 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:33.146127 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:33.146583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:33.147358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:33.147795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:33.154055 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:33.161986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:33.163619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:33.164768 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-882673b9-d6e3-4088-947f-c7df3f478ea3 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1720 microversion: 2.20 time: 0.156601 Jun 20 12:32:33.165320 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 550/1091] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:33 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:33.285295 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:33.292777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-12654119-9a6a-415d-a2ab-b0edfed05d64 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.157874 Jun 20 12:32:33.294513 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 542/1092] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:33 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:34.096857 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-70669b1a-1a39-42be-9345-e86dcec53ca5 req-7902c3aa-7b08-4a0c-bbb2-0a949ca2021f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcac7a1b-19f1-4b18-b565-61b66a9dbbcc", "name": "network-vif-plugged", "status": "completed", "tag": "d74276b7-9da3-4f54-819c-7668b2bca69b"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:34.106604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-70669b1a-1a39-42be-9345-e86dcec53ca5 req-7902c3aa-7b08-4a0c-bbb2-0a949ca2021f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.117051 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-70669b1a-1a39-42be-9345-e86dcec53ca5 req-7902c3aa-7b08-4a0c-bbb2-0a949ca2021f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.118638 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-70669b1a-1a39-42be-9345-e86dcec53ca5 req-7902c3aa-7b08-4a0c-bbb2-0a949ca2021f service nova] Creating event network-vif-plugged:d74276b7-9da3-4f54-819c-7668b2bca69b for instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc on hv-cinder-83697 Jun 20 12:32:34.124231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-70669b1a-1a39-42be-9345-e86dcec53ca5 req-7902c3aa-7b08-4a0c-bbb2-0a949ca2021f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031154 Jun 20 12:32:34.124896 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 551/1093] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:34.183286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:34.183981 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:34.191427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.191872 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.192639 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.193074 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.264798 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:34.274052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:34.275627 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:34.277030 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-759bf898-9d7d-4f6e-98fe-8ee30c9f2d62 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1654 microversion: 2.20 time: 0.097646 Jun 20 12:32:34.278131 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 543/1094] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:34 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1654 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:34.313255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:34.314317 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:34.322964 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.323442 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.324221 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.324708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.351764 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-2079e882-c24b-4ff0-9528-c343d6accd8c req-55050880-cc7a-40b1-b916-e8d7c40ffec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f89bc6b5-c488-4237-b3ca-c18adfee49e0", "name": "network-vif-deleted", "tag": "4a2773eb-9f13-4624-b153-cc5009b4ecd3"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:34.362915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-2079e882-c24b-4ff0-9528-c343d6accd8c req-55050880-cc7a-40b1-b916-e8d7c40ffec0 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:34.364042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-2079e882-c24b-4ff0-9528-c343d6accd8c req-55050880-cc7a-40b1-b916-e8d7c40ffec0 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:34.379540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-2079e882-c24b-4ff0-9528-c343d6accd8c req-55050880-cc7a-40b1-b916-e8d7c40ffec0 service nova] Creating event network-vif-deleted:4a2773eb-9f13-4624-b153-cc5009b4ecd3 for instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 on hv-cinder-83697 Jun 20 12:32:34.388399 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-2079e882-c24b-4ff0-9528-c343d6accd8c req-55050880-cc7a-40b1-b916-e8d7c40ffec0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040644 Jun 20 12:32:34.393962 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 544/1095] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:34.493299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:34.502227 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fbfa5e96-25bd-4512-a13b-d73953248f6c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.193226 Jun 20 12:32:34.502954 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 552/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:34 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:32:34.999772 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:32:35.000004 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Mon Jun 20 12:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:32:35.297081 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:35.297786 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:35.304228 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.304678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.305461 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.305936 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.339244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.339698 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.340208 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lazy-loading 'fault' on Instance uuid f89bc6b5-c488-4237-b3ca-c18adfee49e0 {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:32:35.383498 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:35.392081 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:35.393651 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:35.394869 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cf0efdf2-3ed1-4b19-aae7-0458bd53e0b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 200 len: 1370 microversion: 2.20 time: 0.102819 Jun 20 12:32:35.395617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 545/1097] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:35 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:35.519681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:35.520239 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:35.526820 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.527274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.528734 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:35.529269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:35.666580 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:35.676466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-92a2d8af-9f05-46ba-9523-aae5ec0d4c63 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1267 microversion: 2.1 time: 0.160903 Jun 20 12:32:35.677021 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 553/1098] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:35 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:36.413564 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:36.414215 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:36.421605 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.422093 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.422869 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.423311 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.427448 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:36.437000 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] HTTP exception thrown: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Request method failure captured: Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 HTTP/1.1 Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGg4Z1sO0wWnwoRxZzhJ4p5k0M3A0rQyRcotNBSQAIWXcMoK_MolK5VcjQjhOGdmjCh15mGBdEGey1I1Ur4XnMJQiQvrXeunfUDgLnRsFBNASQl0lhcbnel6CsJV7lwHlPab0rttKmK2TRPrHU9O9dj13wq3ip8Ot3TW6LTo2f2ai5A Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:32:36.438643 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}] Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 65f0d59c17874c949670e0e81c5b74f4 Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:32:36.449073 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'f89bc6b5-c488-4237-b3ca-c18adfee49e0'} Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:32:36.450263 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:32:36.451874 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:32:36.453426 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Returning 404 to user: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:32:36.453426 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-07ab0d37-ae80-41dd-80af-fb22167bb755 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 404 len: 111 microversion: 2.20 time: 0.030506 Jun 20 12:32:36.453426 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 546/1099] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:36 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:32:36.453763 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e3572a09-44c7-4b0f-bd47-f8355e2672f1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '.version_select at 0x7fe2912663a0>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:36.536812 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e3572a09-44c7-4b0f-bd47-f8355e2672f1 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408796169" status: 204 len: 0 microversion: 2.20 time: 0.091759 Jun 20 12:32:36.537439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 554/1100] 10.222.0.64 () {60 vars in 1258 bytes} [Mon Jun 20 12:32:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408796169 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:32:36.694648 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:36.695280 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:36.702784 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.703268 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.704101 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.704795 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.855943 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:36.863588 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e9259d10-481d-48f3-ae65-4d8414490aef tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1453 microversion: 2.1 time: 0.172997 Jun 20 12:32:36.864170 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 547/1101] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:36 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:36.880164 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:36.880902 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:36.886945 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.887886 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:36.888671 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:36.889091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:37.117161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:37.125235 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e073819b-ff14-433f-bfee-5b911905a7c3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1453 microversion: 2.1 time: 0.249057 Jun 20 12:32:37.126018 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 555/1102] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:32:36 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:32:37.428054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-08bbb99f-cdb6-4024-be90-3f84ebcae7e8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'create', calling method: .version_select at 0x7fe290388550>, body: {"keypair": {"name": "tempest-keypair-1408796740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJX8/q6pUK05qJC0nG3yNyNqdJf4bTG3qm7yliax2FQubNIcpecu0PuxpSip+OaMSZm1C9hlKata5Z0i3LumttLWpwlmj+OB/HvDvjaqin/pmyF25ZkYiUu1jJxlqHwX+g=="}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:37.443352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-08bbb99f-cdb6-4024-be90-3f84ebcae7e8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:32:37.447429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-08bbb99f-cdb6-4024-be90-3f84ebcae7e8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for user 65f0d59c17874c949670e0e81c5b74f4 and project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'key_pairs'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:32:37.520574 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-08bbb99f-cdb6-4024-be90-3f84ebcae7e8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.096416 Jun 20 12:32:37.521398 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 548/1103] 10.222.0.64 () {62 vars in 1199 bytes} [Mon Jun 20 12:32:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 12:32:39.173216 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-1812cbd4-9d7b-469d-907d-b4824ccf06df req-5c38f65a-2b45-4ed3-a332-e2b06fea4c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcac7a1b-19f1-4b18-b565-61b66a9dbbcc", "tag": "d74276b7-9da3-4f54-819c-7668b2bca69b"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:39.181966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-1812cbd4-9d7b-469d-907d-b4824ccf06df req-5c38f65a-2b45-4ed3-a332-e2b06fea4c51 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:39.182429 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-1812cbd4-9d7b-469d-907d-b4824ccf06df req-5c38f65a-2b45-4ed3-a332-e2b06fea4c51 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:39.196427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-1812cbd4-9d7b-469d-907d-b4824ccf06df req-5c38f65a-2b45-4ed3-a332-e2b06fea4c51 service nova] Creating event network-changed:d74276b7-9da3-4f54-819c-7668b2bca69b for instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc on hv-cinder-83697 Jun 20 12:32:39.201922 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-1812cbd4-9d7b-469d-907d-b4824ccf06df req-5c38f65a-2b45-4ed3-a332-e2b06fea4c51 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033763 Jun 20 12:32:39.205941 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 556/1104] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:40.218244 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2108639172", "imageRef": "c1c25756-7e31-4d84-a3f6-aba02c442309", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6271bc85-da09-4b74-920d-ca8776e6507c"}], "security_groups": [{"name": "tempest-securitygroup--665083096"}], "key_name": "tempest-keypair-1408796740", "user_data": "}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:40.324342 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.network.neutron [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] validate_networks() for [('6271bc85-da09-4b74-920d-ca8776e6507c', None, None, None, None, None)] {{(pid=118091) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 12:32:40.680847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Flavor limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 12:32:40.681308 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Image limits 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 12:32:40.681789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Flavor pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 12:32:40.682227 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Image pref 0:0:0 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 12:32:40.682641 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.virt.hardware [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118091) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 12:32:40.691475 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.692022 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.692828 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:40.693270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:40.710761 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 12:32:40.714699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.quota [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Getting quotas for user 65f0d59c17874c949670e0e81c5b74f4 and project 882feee6f30d4e52b8ab28f7e7193568. Resources: {'ram', 'instances', 'cores'} {{(pid=118091) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 12:32:40.726300 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Going to run 1 instances... {{(pid=118091) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 12:32:40.728538 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1c25756-7e31-4d84-a3f6-aba02c442309',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118091) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 12:32:40.913529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d5276a4e-61a7-4cd6-9bc0-95800f2885de tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.700817 Jun 20 12:32:40.914125 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 549/1105] 10.222.0.64 () {62 vars in 1187 bytes} [Mon Jun 20 12:32:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 12:32:40.925950 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-519139d4-6794-4b40-9001-998d96a56c32 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:40.926774 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-519139d4-6794-4b40-9001-998d96a56c32 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:40.989642 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-519139d4-6794-4b40-9001-998d96a56c32 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:40.998225 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-519139d4-6794-4b40-9001-998d96a56c32 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:41.000656 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-519139d4-6794-4b40-9001-998d96a56c32 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:41.000917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-519139d4-6794-4b40-9001-998d96a56c32 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1282 microversion: 2.20 time: 0.080570 Jun 20 12:32:41.001517 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 557/1106] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:40 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:42.019295 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:42.019904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:42.028823 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:42.029328 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:42.030173 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:42.030617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:42.093062 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:42.101111 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:42.102702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:42.103859 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-83a6fcf1-149f-4509-a232-2d223e92d03a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1286 microversion: 2.20 time: 0.088659 Jun 20 12:32:42.109067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 550/1107] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:42 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:43.120913 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:43.127788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:43.129034 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:43.129492 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:43.130300 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:43.130740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:43.476953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:43.485203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:43.486787 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:43.487893 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6d96655a-2ef6-4cb6-8c43-b29331469634 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1342 microversion: 2.20 time: 0.371079 Jun 20 12:32:43.488445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 558/1108] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:43 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1342 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:44.506323 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:44.506913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:44.513542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:44.514042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:44.514829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:44.515270 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:44.885774 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:44.894806 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:44.896417 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:44.897552 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9ef8d046-9dba-4b9e-b1d8-3f791998b8ff tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.395434 Jun 20 12:32:44.898155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 551/1109] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:44 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:45.111439 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-fc209f69-e7ec-450f-9e66-6abd5404a568 req-030edcf5-9407-43aa-a5d9-381713fccfea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca", "tag": "a153f1e2-8f1b-4917-87a9-323c0e6cba3c"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:45.124464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fc209f69-e7ec-450f-9e66-6abd5404a568 req-030edcf5-9407-43aa-a5d9-381713fccfea service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.124464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-fc209f69-e7ec-450f-9e66-6abd5404a568 req-030edcf5-9407-43aa-a5d9-381713fccfea service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.135655 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-fc209f69-e7ec-450f-9e66-6abd5404a568 req-030edcf5-9407-43aa-a5d9-381713fccfea service nova] Creating event network-changed:a153f1e2-8f1b-4917-87a9-323c0e6cba3c for instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca on hv-cinder-83697 Jun 20 12:32:45.142068 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-fc209f69-e7ec-450f-9e66-6abd5404a568 req-030edcf5-9407-43aa-a5d9-381713fccfea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035081 Jun 20 12:32:45.142708 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 559/1110] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:45.917333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:45.917926 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:45.925356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.925824 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:45.926604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:45.927326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:46.061873 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:46.070090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:46.074017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:46.074017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d0795f50-6fa2-4520-afe4-17bc432eca9b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.159722 Jun 20 12:32:46.074017 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 552/1111] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:45 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:47.093246 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:47.093971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:47.100144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:47.100593 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:47.101354 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:47.101788 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:47.236397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:47.244441 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:47.246029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:47.247278 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-17858103-f03d-458d-989c-6120ba6446c6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.159500 Jun 20 12:32:47.247838 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 560/1112] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:47 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:48.265105 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:48.265768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:48.272521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:48.272960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:48.273773 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:48.274225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:48.405340 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:48.413295 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:48.414896 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:48.416004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4ed4e3a3-9e23-4b73-bb5d-6af42bd4fce0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.154949 Jun 20 12:32:48.416571 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 553/1113] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:48 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:49.433943 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:49.434485 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:49.441939 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:49.442378 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:49.443128 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:49.443552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:49.572351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:49.580589 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:49.582168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:49.583268 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c854b015-98fb-40a2-9ade-fefbc3dbdb97 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.153374 Jun 20 12:32:49.583816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 561/1114] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:49 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:50.600777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:50.601390 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:50.603533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:50.608512 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:50.620439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:50.620439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:50.620439 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:50.701531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=2 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:50.722466 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell0:SELECT=10 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:50.760937 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:50.770346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:50.771913 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:50.775053 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-bd9815cf-dc00-4c74-b5f0-853712eff666 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.176329 Jun 20 12:32:50.775053 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 554/1115] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:50 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:51.792131 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:51.792730 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:51.795207 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell0:SELECT=2 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:51.796102 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:51.802017 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:51.802460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:51.803218 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:51.803646 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:51.806142 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=99 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:52.118096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:52.126865 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:52.128400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:52.129509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d05ac9b5-5328-46d1-a495-c6d0e3e61fad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.341407 Jun 20 12:32:52.130259 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 562/1116] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:51 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:52.165346 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-391a7b39-73a8-4746-b9a5-0df93d6fa45f req-2eac01b3-b9ea-4bda-a463-d15ae49b0c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca", "name": "network-vif-plugged", "status": "completed", "tag": "a153f1e2-8f1b-4917-87a9-323c0e6cba3c"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:52.175602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-391a7b39-73a8-4746-b9a5-0df93d6fa45f req-2eac01b3-b9ea-4bda-a463-d15ae49b0c6a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:52.176049 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-391a7b39-73a8-4746-b9a5-0df93d6fa45f req-2eac01b3-b9ea-4bda-a463-d15ae49b0c6a service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:52.187385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-391a7b39-73a8-4746-b9a5-0df93d6fa45f req-2eac01b3-b9ea-4bda-a463-d15ae49b0c6a service nova] Creating event network-vif-plugged:a153f1e2-8f1b-4917-87a9-323c0e6cba3c for instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca on hv-cinder-83697 Jun 20 12:32:52.192690 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-391a7b39-73a8-4746-b9a5-0df93d6fa45f req-2eac01b3-b9ea-4bda-a463-d15ae49b0c6a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031020 Jun 20 12:32:52.193275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 555/1117] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:32:53.147507 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:53.148149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:53.154401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:53.154853 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:53.155618 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:53.156058 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:53.284062 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:53.291959 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:53.293548 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:53.294683 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a09fdb11-ef4b-4d14-971e-8bdc95a25119 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1407 microversion: 2.20 time: 0.151230 Jun 20 12:32:53.295242 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 563/1118] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:53 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:54.314187 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:54.315155 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:54.321387 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:54.321845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:54.322928 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:54.323358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:54.512533 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:54.521300 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:54.522899 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:32:54.524066 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-86915b97-d007-4b18-a6d0-76d2314ae27f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1598 microversion: 2.20 time: 0.215275 Jun 20 12:32:54.528511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 556/1119] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:32:54 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1598 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:32:54.541531 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c12b5b9e-2767-4b05-bde0-6c52811ee6b9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:32:54.542089 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c12b5b9e-2767-4b05-bde0-6c52811ee6b9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:32:54.549522 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c12b5b9e-2767-4b05-bde0-6c52811ee6b9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:54.550001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c12b5b9e-2767-4b05-bde0-6c52811ee6b9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:54.550754 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c12b5b9e-2767-4b05-bde0-6c52811ee6b9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:54.551182 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c12b5b9e-2767-4b05-bde0-6c52811ee6b9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:54.634270 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c12b5b9e-2767-4b05-bde0-6c52811ee6b9 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096500 Jun 20 12:32:54.634863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 564/1120] 10.222.0.64 () {60 vars in 1315 bytes} [Mon Jun 20 12:32:54 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:32:55.642577 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-1286615d-22d8-4698-a8a9-d995dfbc728f req-e7812fd1-8fbf-4af1-80cb-705c5269b59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca", "tag": "a153f1e2-8f1b-4917-87a9-323c0e6cba3c"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:32:55.652809 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1286615d-22d8-4698-a8a9-d995dfbc728f req-e7812fd1-8fbf-4af1-80cb-705c5269b59f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:32:55.653357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-1286615d-22d8-4698-a8a9-d995dfbc728f req-e7812fd1-8fbf-4af1-80cb-705c5269b59f service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:32:55.666139 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-1286615d-22d8-4698-a8a9-d995dfbc728f req-e7812fd1-8fbf-4af1-80cb-705c5269b59f service nova] Creating event network-changed:a153f1e2-8f1b-4917-87a9-323c0e6cba3c for instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca on hv-cinder-83697 Jun 20 12:32:55.673732 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-1286615d-22d8-4698-a8a9-d995dfbc728f req-e7812fd1-8fbf-4af1-80cb-705c5269b59f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035176 Jun 20 12:32:55.675086 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 557/1121] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:33:31.470460 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=5 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:31.471133 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=15 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:31.475228 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fa970ed8-3e7d-4d29-befb-064a0587e265 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:31.475715 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fa970ed8-3e7d-4d29-befb-064a0587e265 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:31.482287 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fa970ed8-3e7d-4d29-befb-064a0587e265 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:31.484827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fa970ed8-3e7d-4d29-befb-064a0587e265 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:31.484827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fa970ed8-3e7d-4d29-befb-064a0587e265 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:31.484827 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fa970ed8-3e7d-4d29-befb-064a0587e265 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:31.507542 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fa970ed8-3e7d-4d29-befb-064a0587e265 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/ips" status: 200 len: 150 microversion: 2.20 time: 0.038642 Jun 20 12:33:31.508236 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 565/1122] 10.222.0.64 () {60 vars in 1288 bytes} [Mon Jun 20 12:33:31 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 12:33:33.689063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=7 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:33.689827 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=48 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:33.694158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:33.704826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:33.704826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:33.704826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:33.704826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:33.705238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:33.729333 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lazy-loading 'flavor' on Instance uuid 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:33:34.405368 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-9fe6d0ce-e7e1-4b03-bc39-70912b858a27 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/action" status: 202 len: 0 microversion: 2.20 time: 0.717786 Jun 20 12:33:34.406012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 558/1123] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 20 12:33:33 2022] POST /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:33:34.414566 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:34.415184 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:34.422497 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:34.422937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:34.423701 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:34.424130 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:34.561578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:34.569518 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:34.571073 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:34.572220 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-fb45a417-ba7c-42e2-8223-a378ba591949 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.162080 Jun 20 12:33:34.572828 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 566/1124] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:34 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:35.592555 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:35.596521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:35.599843 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:35.600291 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:35.601042 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:35.601480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:35.731830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:35.739868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:35.741457 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:35.742655 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5b4e8d56-dfb2-4233-9b2f-dd01738f7874 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.155777 Jun 20 12:33:35.743278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 559/1125] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:35 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:36.762399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:36.762970 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:36.769530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:36.770013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:36.770813 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:36.771251 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:36.899672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:36.907597 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:36.909139 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:36.910319 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a895f98c-95d8-40ba-be9c-dc11c304f5ad tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.152185 Jun 20 12:33:36.910872 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 567/1126] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:36 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:37.929152 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:37.929719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:37.936441 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:37.936885 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:37.937673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:37.938140 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:38.065698 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:38.074018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:38.075792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:38.076961 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f382e802-5bf2-471f-bc61-eb7f03aa9346 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.151927 Jun 20 12:33:38.077531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 560/1127] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:37 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:39.094777 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:39.095391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:39.101937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:39.102414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:39.103181 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:39.103619 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:39.233026 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:39.240903 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:39.242483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:39.243626 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-19bba62a-e44d-4ed7-a9aa-e0ed0018d709 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.152844 Jun 20 12:33:39.244214 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 568/1128] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:39 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:40.261793 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:40.263126 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:40.269583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:40.270066 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:40.270833 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:40.271271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:40.401409 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:40.410182 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:40.411768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:40.412937 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c5a2d0d7-57ba-4d79-b51f-462a89e3140d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.155109 Jun 20 12:33:40.413526 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 561/1129] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:40 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:41.432499 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:41.433102 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:41.439802 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:41.440244 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:41.440997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:41.441425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:41.568347 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:41.577438 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:41.579035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:41.580168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d729ae59-86c1-4792-8835-0f4c1cc4a601 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.151650 Jun 20 12:33:41.580715 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 569/1130] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:41 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:42.598153 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:42.598684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:42.605071 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:42.605515 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:42.607531 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:42.607971 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:42.735655 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:42.743768 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:42.745335 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:42.746534 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ecfed9f4-49f3-4165-91ce-5d69332d5c25 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.152420 Jun 20 12:33:42.747095 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 562/1131] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:42 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:43.764878 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:43.765573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:43.772199 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:43.772645 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:43.773446 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:43.773914 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:43.905933 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:43.913865 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:43.915404 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:43.916555 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-355982dc-8c87-48e0-a449-c06df2cea022 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.155883 Jun 20 12:33:43.917105 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 570/1132] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:43 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:44.935149 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:44.935781 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:44.942429 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:44.942875 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:44.943639 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:44.944079 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:45.077124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:45.085172 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:45.086750 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:45.087915 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8b3380a9-88b9-47db-87ff-21d6ef963b11 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.156842 Jun 20 12:33:45.088469 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 563/1133] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:44 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:33:46.106756 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:46.107443 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:46.114018 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:46.117571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:46.117571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:46.117571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:46.245677 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:46.253722 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:46.255352 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:46.256513 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a9612ca7-7395-4963-991f-5b28c25f42aa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.154457 Jun 20 12:33:46.257092 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 571/1134] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:46 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:47.274554 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:47.275158 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:47.282054 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:47.282495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:47.283256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:47.283684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:47.412003 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:47.420435 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:47.422271 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:47.423425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-cda81fee-529f-441e-99e7-101e82894fd6 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.152832 Jun 20 12:33:47.423976 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 564/1135] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:47 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:48.441519 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:48.442154 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:48.448593 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:48.449035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:48.449860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:48.450272 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:48.577673 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:48.585709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:48.587297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:48.588448 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6a74ee8b-dc3c-49c1-afb5-7cb8557f713a tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.150915 Jun 20 12:33:48.589011 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 572/1136] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:48 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:49.608041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:49.608692 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:49.615034 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:49.615483 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:49.616254 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:49.616695 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:49.745396 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:49.754124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:49.755693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:49.756862 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-251d45b8-a773-42f9-9ad9-5230e84ebdbe tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.153480 Jun 20 12:33:49.757423 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 565/1137] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:49 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:50.775285 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:50.775830 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:50.782470 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:50.782918 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:50.783681 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:50.784117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:50.916845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:50.925860 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:50.927413 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:50.928604 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-52a178fa-4b18-4888-a461-90a91b0ad6c8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1743 microversion: 2.20 time: 0.157405 Jun 20 12:33:50.929191 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 573/1138] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:50 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:51.948102 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:51.948713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:51.955230 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:51.955706 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:51.956546 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:51.957052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:52.094432 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:52.102687 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:52.104316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:52.105479 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3b281927-9f80-48b4-8014-8cc1cde834bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1743 microversion: 2.20 time: 0.161509 Jun 20 12:33:52.106179 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 566/1139] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:51 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:53.126282 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:53.126894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:53.136149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:53.136867 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:53.138277 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:53.138909 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:53.278263 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:53.289459 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:53.291061 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:53.297635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ac2bd1a4-2690-428b-a9a7-6d7f53e9a268 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.171966 Jun 20 12:33:53.297635 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 574/1140] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:53 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:33:54.313116 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:54.313745 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:54.320993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:54.321444 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:54.322308 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:54.322918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:54.462137 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-f1ae01fd-02cd-42f1-a67e-1b9760854236 req-a784cf05-9474-4310-8a5f-9397f91f9810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca", "name": "network-vif-plugged", "status": "completed", "tag": "a153f1e2-8f1b-4917-87a9-323c0e6cba3c"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:33:54.468502 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:54.477156 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:54.481750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-f1ae01fd-02cd-42f1-a67e-1b9760854236 req-a784cf05-9474-4310-8a5f-9397f91f9810 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:54.481750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-f1ae01fd-02cd-42f1-a67e-1b9760854236 req-a784cf05-9474-4310-8a5f-9397f91f9810 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:54.482219 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:54.482219 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f64e8cd9-bcf0-4f4d-afce-4e8e00199b49 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.171380 Jun 20 12:33:54.482219 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 567/1141] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:54 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:54.493539 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-f1ae01fd-02cd-42f1-a67e-1b9760854236 req-a784cf05-9474-4310-8a5f-9397f91f9810 service nova] Creating event network-vif-plugged:a153f1e2-8f1b-4917-87a9-323c0e6cba3c for instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca on hv-cinder-83697 Jun 20 12:33:54.499543 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-f1ae01fd-02cd-42f1-a67e-1b9760854236 req-a784cf05-9474-4310-8a5f-9397f91f9810 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042036 Jun 20 12:33:54.500202 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 575/1142] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:33:55.501299 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:55.502392 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:55.510525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.511052 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.512070 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:55.512816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:55.665344 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:55.675316 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:55.677252 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:55.678645 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-6a01c98f-471e-460a-9fee-48e27bf34e09 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.182341 Jun 20 12:33:55.679330 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 568/1143] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:55 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:56.699153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:56.700648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:56.708427 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:56.708999 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:56.709967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:56.710400 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:56.865516 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:56.876786 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:56.878388 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:56.879603 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-9a5bbe7c-3cb9-4f59-84a4-193240e1b668 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.185072 Jun 20 12:33:56.880498 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 576/1144] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:56 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:57.907713 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:57.908449 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:57.914670 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:57.915131 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:57.915910 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:57.916357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:58.088018 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:58.096886 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:58.098491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:58.099664 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ae615135-1330-4ffc-b911-fae2839ee5ba tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.197504 Jun 20 12:33:58.100235 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 569/1145] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:57 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:33:59.117466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:33:59.118117 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:33:59.129540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:59.135863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:59.142328 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:33:59.142801 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:33:59.286269 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:59.296805 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:59.298757 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:33:59.300105 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-aa999935-bb09-49f0-942b-4ad36a8ecd99 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.186854 Jun 20 12:33:59.302169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 577/1146] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:33:59 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:00.318389 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:00.319699 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:00.327619 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:00.328002 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:00.328789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:00.329231 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:00.476053 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:00.485095 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:00.486801 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:00.488136 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b65f6254-0194-42e1-933e-dfd7d3f05094 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.173588 Jun 20 12:34:00.506056 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 570/1147] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:00 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:01.508759 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:01.509608 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:01.512133 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=27 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:01.517605 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:01.518168 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:01.519014 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:01.519664 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:01.674847 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:01.683863 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:01.685752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:01.687031 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-0eded211-82c4-4263-9f99-4a5c33df51d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.182470 Jun 20 12:34:01.687890 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 578/1148] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:01 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:02.706953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:02.707633 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:02.715313 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:02.716282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:02.717122 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:02.717617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:02.853684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:02.862631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:02.866198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:02.866198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-91fb655f-2c84-4f2c-a2e1-088be5f95413 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1738 microversion: 2.20 time: 0.162993 Jun 20 12:34:02.866198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 571/1149] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:02 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:03.883738 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:03.884412 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:03.891374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:03.891813 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:03.892573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:03.893106 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:04.204406 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:04.212648 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:04.214352 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:04.215530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-08a22f1f-671d-437a-a9a1-1e4fbe33fe68 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1720 microversion: 2.20 time: 0.335759 Jun 20 12:34:04.216096 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 579/1150] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:03 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1720 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:05.235549 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:05.236112 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:05.238532 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=29 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:05.243325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:05.243777 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:05.244585 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:05.245028 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:05.247577 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:05.376278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:05.384191 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:05.385748 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:05.386931 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-38acdc80-db82-493e-b72b-a4f6a484f900 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1720 microversion: 2.20 time: 0.156035 Jun 20 12:34:05.387488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 572/1151] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:05 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:06.405429 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:06.406087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:06.412725 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:06.413206 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:06.414018 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:06.414458 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:06.418600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=85 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:06.543267 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:06.551378 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:06.552923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:06.554093 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-16886615-8755-4403-a0bf-c318b8cb7bbc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1720 microversion: 2.20 time: 0.152842 Jun 20 12:34:06.554649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 580/1152] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:06 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:07.572870 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:07.573488 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:07.580848 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:07.581302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:07.582099 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:07.582546 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:07.714604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:07.723413 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:07.724970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:07.726185 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1e37287b-d9b4-48ee-ab3c-a08537d58da0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1663 microversion: 2.20 time: 0.157224 Jun 20 12:34:07.726758 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 573/1153] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:07 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:07.744048 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-3b3be167-e02e-405a-8a47-87d0922c0d0e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b652262-af0b-469e-b3e3-87cef576cd03"}} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:07.745136 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-3b3be167-e02e-405a-8a47-87d0922c0d0e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:07.752289 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3b3be167-e02e-405a-8a47-87d0922c0d0e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:07.752740 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3b3be167-e02e-405a-8a47-87d0922c0d0e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:07.753505 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3b3be167-e02e-405a-8a47-87d0922c0d0e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:07.753986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-3b3be167-e02e-405a-8a47-87d0922c0d0e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:08.440044 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-9715bae8-1981-4d44-90af-0363bae4aee7 req-736ee9f6-98f6-4674-ab07-f4cb4ea4e713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca", "name": "network-vif-unplugged", "status": "completed", "tag": "a153f1e2-8f1b-4917-87a9-323c0e6cba3c"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:08.448356 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-9715bae8-1981-4d44-90af-0363bae4aee7 req-736ee9f6-98f6-4674-ab07-f4cb4ea4e713 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:08.448792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-9715bae8-1981-4d44-90af-0363bae4aee7 req-736ee9f6-98f6-4674-ab07-f4cb4ea4e713 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:08.460408 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.compute.server_external_events [req-9715bae8-1981-4d44-90af-0363bae4aee7 req-736ee9f6-98f6-4674-ab07-f4cb4ea4e713 service nova] Unable to find a host for instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca. Dropping event network-vif-unplugged {{(pid=118091) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 12:34:08.461273 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-9715bae8-1981-4d44-90af-0363bae4aee7 req-736ee9f6-98f6-4674-ab07-f4cb4ea4e713 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025800 Jun 20 12:34:08.461862 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 574/1154] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 12:34:08.775775 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-3b3be167-e02e-405a-8a47-87d0922c0d0e tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.035761 Jun 20 12:34:08.776326 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 581/1155] 10.222.0.64 () {62 vars in 1363 bytes} [Mon Jun 20 12:34:07 2022] POST /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-volume_attachments => generated 188 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 12:34:08.891450 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-59426aff-5f7f-460b-91f2-e5e5b5d35403 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:08.891975 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-59426aff-5f7f-460b-91f2-e5e5b5d35403 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:08.898317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-59426aff-5f7f-460b-91f2-e5e5b5d35403 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:08.898760 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-59426aff-5f7f-460b-91f2-e5e5b5d35403 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:08.899516 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-59426aff-5f7f-460b-91f2-e5e5b5d35403 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:08.899950 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-59426aff-5f7f-460b-91f2-e5e5b5d35403 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:09.430602 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-59426aff-5f7f-460b-91f2-e5e5b5d35403 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-volume_attachments/0b652262-af0b-469e-b3e3-87cef576cd03" status: 202 len: 0 microversion: 2.20 time: 0.544058 Jun 20 12:34:09.431132 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 575/1156] 10.222.0.64 () {60 vars in 1456 bytes} [Mon Jun 20 12:34:08 2022] DELETE /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-volume_attachments/0b652262-af0b-469e-b3e3-87cef576cd03 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:34:09.486953 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e7bc7bd3-f40f-4909-a424-ace52a4311d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:09.487605 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e7bc7bd3-f40f-4909-a424-ace52a4311d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:09.494389 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7bc7bd3-f40f-4909-a424-ace52a4311d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:09.494856 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7bc7bd3-f40f-4909-a424-ace52a4311d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:09.495626 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7bc7bd3-f40f-4909-a424-ace52a4311d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:09.496065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e7bc7bd3-f40f-4909-a424-ace52a4311d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:09.699153 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e7bc7bd3-f40f-4909-a424-ace52a4311d7 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "POST /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/action" status: 202 len: 0 microversion: 2.20 time: 0.216059 Jun 20 12:34:09.699937 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 582/1157] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 20 12:34:09 2022] POST /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:34:09.708694 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:09.709374 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:09.715649 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:09.716098 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:09.717341 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:09.717487 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:09.847060 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:09.855198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:09.856757 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:09.858562 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-4094847f-df89-4954-9935-4d80bde59366 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1671 microversion: 2.20 time: 0.154057 Jun 20 12:34:09.859124 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 576/1158] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:09 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:10.878640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:10.879360 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:10.885759 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:10.886385 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:10.887231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:10.887666 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:11.117597 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:11.128745 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:11.130405 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:11.131581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c23192b4-8e38-43f4-9698-59fffacbf258 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1671 microversion: 2.20 time: 0.257756 Jun 20 12:34:11.132233 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 583/1159] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:10 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1671 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:11.259364 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:11.260612 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:11.268766 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:11.269347 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:11.270525 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:11.271012 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:11.302005 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:34:11.335726 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-bc773d2c-9d8e-4468-9d84-b61a5d9e0313 req-b0595048-81f3-43f5-91cc-99bf3e483529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcac7a1b-19f1-4b18-b565-61b66a9dbbcc", "tag": "d74276b7-9da3-4f54-819c-7668b2bca69b"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:11.345540 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-bc773d2c-9d8e-4468-9d84-b61a5d9e0313 req-b0595048-81f3-43f5-91cc-99bf3e483529 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:11.347355 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-bc773d2c-9d8e-4468-9d84-b61a5d9e0313 req-b0595048-81f3-43f5-91cc-99bf3e483529 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:11.362929 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-bc773d2c-9d8e-4468-9d84-b61a5d9e0313 req-b0595048-81f3-43f5-91cc-99bf3e483529 service nova] Creating event network-changed:d74276b7-9da3-4f54-819c-7668b2bca69b for instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc on hv-cinder-83697 Jun 20 12:34:11.367923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-bc773d2c-9d8e-4468-9d84-b61a5d9e0313 req-b0595048-81f3-43f5-91cc-99bf3e483529 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110003 Jun 20 12:34:11.368521 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 584/1160] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:11.591004 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3ea3fbd1-631e-4865-aa81-0852c6ec7509 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 204 len: 0 microversion: 2.1 time: 0.335333 Jun 20 12:34:11.598035 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 577/1161] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:34:11 2022] DELETE /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 12:34:11.602351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:11.602351 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:11.610296 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:11.610743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:11.611672 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:11.612276 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:11.752119 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:11.760841 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-ffcee9bf-01a2-4572-8146-ed8ed57cbeb7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1578 microversion: 2.1 time: 0.163755 Jun 20 12:34:11.761401 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 585/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:11 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:12.150762 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:12.151478 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:12.158286 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:12.158755 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:12.159540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:12.160014 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:12.295673 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:12.304789 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:12.306331 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:12.307521 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-52a048a7-f48a-49d3-8f15-c0b1f9ef59af tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.161140 Jun 20 12:34:12.308078 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 578/1163] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:12 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:12.778919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:12.779671 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:12.786264 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:12.786743 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:12.787515 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:12.787955 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:12.990445 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:12.998539 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c32d7f22-1186-41f8-a510-3f629570aff4 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1578 microversion: 2.1 time: 0.223072 Jun 20 12:34:12.999114 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 586/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:12 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1578 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:13.326720 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:13.327304 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:13.333970 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:13.334458 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:13.335235 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:13.335678 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:13.472409 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:13.480282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:13.481859 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:13.483752 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-5a013c63-94bb-4fbc-9442-67accb575f37 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.161384 Jun 20 12:34:13.484314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 579/1165] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:13 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:14.015651 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:14.016186 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:14.024040 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:14.024483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:14.025508 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:14.025974 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:14.064711 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [req-63b1fc59-242e-42d9-b574-6da288657043 req-0e4497da-59d4-4600-85fb-ec5bfdd11546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcac7a1b-19f1-4b18-b565-61b66a9dbbcc", "name": "network-vif-deleted", "tag": "d74276b7-9da3-4f54-819c-7668b2bca69b"}]} {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:14.073254 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-63b1fc59-242e-42d9-b574-6da288657043 req-0e4497da-59d4-4600-85fb-ec5bfdd11546 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:14.073719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [req-63b1fc59-242e-42d9-b574-6da288657043 req-0e4497da-59d4-4600-85fb-ec5bfdd11546 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:14.091941 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.compute.server_external_events [req-63b1fc59-242e-42d9-b574-6da288657043 req-0e4497da-59d4-4600-85fb-ec5bfdd11546 service nova] Creating event network-vif-deleted:d74276b7-9da3-4f54-819c-7668b2bca69b for instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc on hv-cinder-83697 Jun 20 12:34:14.096942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [req-63b1fc59-242e-42d9-b574-6da288657043 req-0e4497da-59d4-4600-85fb-ec5bfdd11546 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036454 Jun 20 12:34:14.097592 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 580/1166] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:14.098553 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:14.106425 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1aedbc7a-e9c6-4383-a9cc-1a3e2e3f78b7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1391 microversion: 2.1 time: 0.095675 Jun 20 12:34:14.107789 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 587/1167] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:14 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:14.502739 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:14.503438 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:14.509595 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:14.510091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:14.511100 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:14.511625 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:14.800032 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:14.800032 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:14.801196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:14.801196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-163e5b98-f128-4199-b810-5e69ae34a2fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.160952 Jun 20 12:34:14.801196 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 581/1168] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:14 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:15.132125 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:15.133500 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:15.140323 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:15.140771 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:15.141543 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:15.142047 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:15.175338 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:15.176050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:15.176674 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:15.221986 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:15.230137 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-922a3160-984c-44cc-9eda-e63d59e230bc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.109347 Jun 20 12:34:15.241631 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 588/1169] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:15 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:15.677310 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:15.678898 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:15.686759 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:15.688538 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:15.689714 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:15.690248 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:15.831283 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:15.841382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:15.843728 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:15.844628 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8294dd0f-ac66-48eb-a0ce-9dbb912004b5 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.171325 Jun 20 12:34:15.845385 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 582/1170] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:15 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:16.249846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:16.251274 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:16.258383 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:16.259065 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:16.260043 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:16.260493 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:16.296330 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:16.296782 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:16.297374 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:16.344898 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:16.352932 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d0535cca-6884-430a-8205-bb6ed1f0073e tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.108235 Jun 20 12:34:16.353720 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 589/1171] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:16 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:16.863529 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:16.864261 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:16.870812 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:16.871258 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:16.872037 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:16.872480 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:17.027128 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:17.037302 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:17.038953 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:17.040292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e3022989-69b5-4c65-a78c-0702776017bf tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.180703 Jun 20 12:34:17.041082 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 583/1172] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:16 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:17.370552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:17.372013 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:17.379158 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:17.379699 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:17.380552 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:17.381083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:17.418595 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:17.419266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:17.419797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:17.464212 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:17.473249 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-e19573e9-8646-4cf6-8525-d90f4f97fd2c tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.106629 Jun 20 12:34:17.474203 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 590/1173] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:17 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:18.060188 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:18.061272 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:18.068092 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:18.068626 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:18.069586 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:18.070135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:18.216540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:18.225754 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:18.227358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:18.228542 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d1b6a84f-4fa5-4c84-8211-169acfbc329f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.172373 Jun 20 12:34:18.233011 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 584/1174] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:18 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:18.490063 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:18.490789 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:18.497497 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:18.498605 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:18.499466 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:18.499967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:18.533997 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:18.534568 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:18.535087 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:18.578055 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:18.585705 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-83f09267-92f6-484a-b001-97b5af4b5ea0 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.099626 Jun 20 12:34:18.586329 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 591/1175] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:18 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:19.247567 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:19.248733 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:19.257685 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:19.258503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:19.259292 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:19.259910 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:19.408814 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:19.415135 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:19.418864 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:19.420977 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:19.422211 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-eb2fc685-a835-4b41-9cae-7bc4f8ae0426 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.178497 Jun 20 12:34:19.423261 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 585/1176] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:19 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:19.603170 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:19.603828 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:19.611297 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:19.611750 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:19.612541 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:19.612978 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:19.630143 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:19.647571 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:19.648295 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:19.648917 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:19.694779 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:19.702700 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-6e923ccf-16cc-499e-96d8-d23a594be1fc tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.103520 Jun 20 12:34:19.704056 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 592/1177] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:19 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:20.442063 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:20.442712 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:20.449289 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:20.449747 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:20.450600 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:20.451547 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:20.604199 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:20.613716 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:20.615826 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:20.617091 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-ffc94984-b0b2-42e2-88d0-e97a380c2357 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.179686 Jun 20 12:34:20.617720 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 586/1178] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:20 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:20.722105 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:20.723447 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:20.731001 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:20.734565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:20.734565 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:20.734951 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:20.769198 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:20.769573 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:20.770049 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:20.819008 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:20.827056 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-edd813f3-7101-40bf-9811-bc5a7b6c38f9 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.111393 Jun 20 12:34:20.827816 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 593/1179] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:20 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:21.635969 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:21.636591 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:21.644535 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.644985 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.645763 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.646234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.788314 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:21.797554 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:21.799417 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:21.800605 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-8fa2ec4e-bbfe-44fa-85da-0610c27dd0a0 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.168782 Jun 20 12:34:21.801176 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 587/1180] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:21 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:34:21.844600 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:21.845255 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:21.851852 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.852298 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.853333 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.853587 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.888487 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:21.889450 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:21.889924 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:21.934280 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:21.946327 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-c5ce2ff8-caa6-4e27-a4e2-a6a99356ce99 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.106507 Jun 20 12:34:21.956172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 594/1181] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:21 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:22.819327 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:22.820013 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:22.826663 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.827114 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.827885 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.828322 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.962748 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:22.963919 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:22.964539 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:22.971287 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.971637 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:22.971773 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.972520 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:22.972960 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:22.973198 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:22.974408 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-0232d9f7-d060-4d42-9338-288d3360943d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.159123 Jun 20 12:34:22.974974 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 588/1182] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:22 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:23.003535 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:23.003980 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:23.004463 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.objects.instance [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid dcac7a1b-19f1-4b18-b565-61b66a9dbbcc {{(pid=118092) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:23.048169 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:23.055623 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1a0f3a49-b906-4524-850d-04dc5194ffd5 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 200 len: 1231 microversion: 2.1 time: 0.095734 Jun 20 12:34:23.056179 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 595/1183] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:22 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:34:23.992607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:23.993161 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:24.000527 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:24.000991 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:24.001758 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:24.002218 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:24.074208 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:24.075379 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: dcac7a1b-19f1-4b18-b565-61b66a9dbbcc] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:24.082523 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:24.082971 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:24.083753 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:24.084192 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:24.098071 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] HTTP exception thrown: Instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc could not be found. Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Request method failure captured: Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc HTTP/1.1 Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGdzAnoHw_UER1z20ncn1-RbECz90AKu4yeGKDcKAs5JYpQEM5kbraX8ZksIJSzk67yg1KMivbGKgKlO6jk8gRO5njOOQ_t_Y7NMMIOyiWLWgG4ZZ3UPailrDQMUe33uexeiF9TSGY3RXlCnea5v1QoExwqIAg-SMPt9Z-YmD-LjiRI Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:34:24.099752 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}] Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 648c1ba14f1842a5b4160a7569e3206e Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc could not be found. Jun 20 12:34:24.101428 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'dcac7a1b-19f1-4b18-b565-61b66a9dbbcc'} Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc could not be found. Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:24.102399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc could not be found. Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc could not be found. Jun 20 12:34:24.103797 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:24.105265 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Returning 404 to user: Instance dcac7a1b-19f1-4b18-b565-61b66a9dbbcc could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:24.105265 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-37a29db0-cc84-4d84-815f-1cbdbcd90298 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc" status: 404 len: 111 microversion: 2.1 time: 0.031084 Jun 20 12:34:24.105265 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 596/1184] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:24 2022] GET /compute/v2.1/servers/dcac7a1b-19f1-4b18-b565-61b66a9dbbcc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:24.138359 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:24.146618 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:24.148269 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:24.149449 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-27e9a96d-daa0-4295-a297-edafc6860306 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.160980 Jun 20 12:34:24.150041 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 589/1185] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:23 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:25.167692 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:25.168306 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:25.175234 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:25.175684 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:25.176447 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:25.176884 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:25.308711 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:25.317895 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:25.319451 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:25.320609 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d03e1e2d-fcfc-41b3-9d6f-f18e0b4b1282 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.156975 Jun 20 12:34:25.321172 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 597/1186] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:25 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:26.339702 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:26.340425 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:26.347491 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:26.348011 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:26.348883 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:26.349326 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:26.484846 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:26.492951 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:26.494658 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:26.495830 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3860fe6e-6b9e-4059-82f2-26eb86d1bd1f tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.160464 Jun 20 12:34:26.496383 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 590/1187] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:26 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:27.515598 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:27.516201 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:27.522473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:27.522923 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:27.523688 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:27.524116 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:27.654870 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:27.663436 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:27.664967 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:27.666144 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-74f7ac0d-7c00-4ec5-8d46-5e8c2d90a6fa tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.155031 Jun 20 12:34:27.666695 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 598/1188] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:27 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:28.122210 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:28.122738 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:28.124366 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-2b80de44-22b2-47d6-8932-bbccc65c5bd6 req-083c82ca-c7b0-4636-b0ae-eb09e8deff66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e1194c-76fb-4699-aea3-93553015eb1b", "tag": "450b3ed4-d831-46dd-b515-88afaa090f48"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:28.129778 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.130247 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.131222 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.131660 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.133211 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2b80de44-22b2-47d6-8932-bbccc65c5bd6 req-083c82ca-c7b0-4636-b0ae-eb09e8deff66 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.133720 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-2b80de44-22b2-47d6-8932-bbccc65c5bd6 req-083c82ca-c7b0-4636-b0ae-eb09e8deff66 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.145231 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-2b80de44-22b2-47d6-8932-bbccc65c5bd6 req-083c82ca-c7b0-4636-b0ae-eb09e8deff66 service nova] Creating event network-changed:450b3ed4-d831-46dd-b515-88afaa090f48 for instance 06e1194c-76fb-4699-aea3-93553015eb1b on hv-cinder-83697 Jun 20 12:34:28.150628 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-2b80de44-22b2-47d6-8932-bbccc65c5bd6 req-083c82ca-c7b0-4636-b0ae-eb09e8deff66 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030186 Jun 20 12:34:28.151291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 599/1189] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:34:28.160917 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:34:28.485203 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-d2c2a7c3-b1f3-4017-9eb8-183884a0827a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "DELETE /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 204 len: 0 microversion: 2.1 time: 0.366585 Jun 20 12:34:28.486394 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 591/1190] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:34:28 2022] DELETE /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 12:34:28.495161 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:28.495864 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:28.502263 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.502721 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.503534 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.504159 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.653299 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:28.661973 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-1c4dd121-9244-4deb-8763-1a965d934c84 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1575 microversion: 2.1 time: 0.171013 Jun 20 12:34:28.662693 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 600/1191] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:28 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:28.684957 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:28.685956 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:28.692150 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.692607 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.693383 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.693858 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.825624 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:28.835651 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:28.836802 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:28.838116 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-02281118-94d4-4d69-aad4-4b1948a78b59 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.157476 Jun 20 12:34:28.849149 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 592/1192] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:28 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:28.893413 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-5d7a6265-3388-432e-89a9-06dd9f51e75b req-1e562e29-76fb-4212-afb7-9dbda028f311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca", "name": "network-vif-plugged", "status": "completed", "tag": "a153f1e2-8f1b-4917-87a9-323c0e6cba3c"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:28.901512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-5d7a6265-3388-432e-89a9-06dd9f51e75b req-1e562e29-76fb-4212-afb7-9dbda028f311 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:28.901973 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-5d7a6265-3388-432e-89a9-06dd9f51e75b req-1e562e29-76fb-4212-afb7-9dbda028f311 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:28.913889 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-5d7a6265-3388-432e-89a9-06dd9f51e75b req-1e562e29-76fb-4212-afb7-9dbda028f311 service nova] Creating event network-vif-plugged:a153f1e2-8f1b-4917-87a9-323c0e6cba3c for instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca on hv-cinder-83697 Jun 20 12:34:28.918795 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-5d7a6265-3388-432e-89a9-06dd9f51e75b req-1e562e29-76fb-4212-afb7-9dbda028f311 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088846 Jun 20 12:34:28.919399 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 601/1193] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:29.679540 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:29.680163 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:29.687605 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:29.688067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:29.688827 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:29.689256 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:29.824721 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:29.833296 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-3f2154da-cab5-4a09-a927-bcee7b3179ad tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1575 microversion: 2.1 time: 0.157625 Jun 20 12:34:29.833880 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 593/1194] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:29 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:29.859022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:29.859022 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:29.864444 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:29.864894 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:29.865659 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:29.866140 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:30.348256 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:30.356709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:30.358964 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:30.360147 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-a4d5c167-aa93-415a-8a12-e21d5b49484d tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.507675 Jun 20 12:34:30.364316 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 602/1195] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:29 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:30.851421 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:30.857379 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:30.857509 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-a1829fa9-9f3d-46a8-a67f-ab85b20a067a req-f0d1c4cd-2cb4-45a6-9791-10cca1bc59e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e1194c-76fb-4699-aea3-93553015eb1b", "name": "network-vif-deleted", "tag": "450b3ed4-d831-46dd-b515-88afaa090f48"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:34:30.859009 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:30.859462 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:30.860239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:30.860684 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:30.861831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-a1829fa9-9f3d-46a8-a67f-ab85b20a067a req-f0d1c4cd-2cb4-45a6-9791-10cca1bc59e7 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:30.862273 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-a1829fa9-9f3d-46a8-a67f-ab85b20a067a req-f0d1c4cd-2cb4-45a6-9791-10cca1bc59e7 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:30.873320 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-a1829fa9-9f3d-46a8-a67f-ab85b20a067a req-f0d1c4cd-2cb4-45a6-9791-10cca1bc59e7 service nova] Creating event network-vif-deleted:450b3ed4-d831-46dd-b515-88afaa090f48 for instance 06e1194c-76fb-4699-aea3-93553015eb1b on hv-cinder-83697 Jun 20 12:34:30.878578 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-a1829fa9-9f3d-46a8-a67f-ab85b20a067a req-f0d1c4cd-2cb4-45a6-9791-10cca1bc59e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029845 Jun 20 12:34:30.879173 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 603/1196] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 12:34:30.925321 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:30.932829 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f97aeb0a-8816-4d4d-bfb1-3c40bbd7d87a tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1388 microversion: 2.1 time: 0.085497 Jun 20 12:34:30.933386 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 594/1197] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:30 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:31.379258 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:31.379845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:31.385956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:31.389148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:31.389148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:31.389148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:31.518956 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:31.526846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:31.528372 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:31.529511 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-8671f67b-f558-4da7-a86a-5eafbf97f495 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.154640 Jun 20 12:34:31.530888 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 604/1198] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:31 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 12:34:31.949813 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:31.950552 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:31.958225 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:31.958511 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:31.959275 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:31.959719 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:31.994423 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:31.994852 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:31.995296 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.objects.instance [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lazy-loading 'fault' on Instance uuid 06e1194c-76fb-4699-aea3-93553015eb1b {{(pid=118091) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 12:34:32.036839 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648c1ba14f1842a5b4160a7569e3206e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f8e01a266c4737ad5fa510ed9b2fad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:32.044382 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-1530fd57-a2c4-4b2e-b5e2-fa7180fec768 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 200 len: 1228 microversion: 2.1 time: 0.098617 Jun 20 12:34:32.044942 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 595/1199] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:31 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 12:34:32.549309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:32.549965 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:32.552452 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=72 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:32.557364 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:32.557825 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:32.558607 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:32.559037 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:32.695397 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:32.703483 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:32.707050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:32.707050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-12bd494f-d143-45bc-b265-4b3a583d3d31 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1729 microversion: 2.20 time: 0.161916 Jun 20 12:34:32.707050 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 605/1200] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:32 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:33.062240 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:33.062868 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 06e1194c-76fb-4699-aea3-93553015eb1b] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:33.069381 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.069856 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.070632 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.071067 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.085428 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] HTTP exception thrown: Instance 06e1194c-76fb-4699-aea3-93553015eb1b could not be found. Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Request method failure captured: Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b HTTP/1.1 Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGdzAnoHw_UER1z20ncn1-RbECz90AKu4yeGKDcKAs5JYpQEM5kbraX8ZksIJSzk67yg1KMivbGKgKlO6jk8gRO5njOOQ_t_Y7NMMIOyiWLWgG4ZZ3UPailrDQMUe33uexeiF9TSGY3RXlCnea5v1QoExwqIAg-SMPt9Z-YmD-LjiRI Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:34:33.087090 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}] Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 648c1ba14f1842a5b4160a7569e3206e Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 06e1194c-76fb-4699-aea3-93553015eb1b could not be found. Jun 20 12:34:33.088837 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '06e1194c-76fb-4699-aea3-93553015eb1b'} Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e1194c-76fb-4699-aea3-93553015eb1b could not be found. Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:33.089845 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e1194c-76fb-4699-aea3-93553015eb1b could not be found. Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e1194c-76fb-4699-aea3-93553015eb1b could not be found. Jun 20 12:34:33.091433 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.093522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Returning 404 to user: Instance 06e1194c-76fb-4699-aea3-93553015eb1b could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:33.093522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-f4c5e6d5-8add-4e73-87b0-e4b5399e287b tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b" status: 404 len: 111 microversion: 2.1 time: 0.030695 Jun 20 12:34:33.093522 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 596/1201] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:33 2022] GET /compute/v2.1/servers/06e1194c-76fb-4699-aea3-93553015eb1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:33.611995 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:33.612502 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:33.618906 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.620581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.620581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.620581 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.635657 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] HTTP exception thrown: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Request method failure captured: Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed HTTP/1.1 Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGdzAnoHw_UER1z20ncn1-RbECz90AKu4yeGKDcKAs5JYpQEM5kbraX8ZksIJSzk67yg1KMivbGKgKlO6jk8gRO5njOOQ_t_Y7NMMIOyiWLWgG4ZZ3UPailrDQMUe33uexeiF9TSGY3RXlCnea5v1QoExwqIAg-SMPt9Z-YmD-LjiRI Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:34:33.637829 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}] Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 648c1ba14f1842a5b4160a7569e3206e Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.640266 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '36070a3e-9c08-45f3-a574-2412cabfe0ed'} Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:33.641309 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.642966 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.644512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Returning 404 to user: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:33.644512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-7fb5129a-ca08-4afa-9781-21338a178948 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "DELETE /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 404 len: 111 microversion: 2.1 time: 0.030867 Jun 20 12:34:33.644512 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 606/1202] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 20 12:34:33 2022] DELETE /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:33.647792 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:33.648616 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] [instance: 36070a3e-9c08-45f3-a574-2412cabfe0ed] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:33.654679 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.655865 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.656804 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.657239 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.670659 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] HTTP exception thrown: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Request method failure captured: Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed HTTP/1.1 Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGdzAnoHw_UER1z20ncn1-RbECz90AKu4yeGKDcKAs5JYpQEM5kbraX8ZksIJSzk67yg1KMivbGKgKlO6jk8gRO5njOOQ_t_Y7NMMIOyiWLWgG4ZZ3UPailrDQMUe33uexeiF9TSGY3RXlCnea5v1QoExwqIAg-SMPt9Z-YmD-LjiRI Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:34:33.672495 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/68f8e01a266c4737ad5fa510ed9b2fad"}]}] Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 68f8e01a266c4737ad5fa510ed9b2fad Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-TestVolumeBootPattern-1832776522 Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 648c1ba14f1842a5b4160a7569e3206e Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-TestVolumeBootPattern-1832776522-project Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.674452 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '36070a3e-9c08-45f3-a574-2412cabfe0ed'} Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:34:33.675507 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. Jun 20 12:34:33.677089 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:34:33.678989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Returning 404 to user: Instance 36070a3e-9c08-45f3-a574-2412cabfe0ed could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:34:33.678989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-524a0ea7-d064-4a0b-bd6b-016ec125bea3 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed" status: 404 len: 111 microversion: 2.1 time: 0.030137 Jun 20 12:34:33.678989 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 597/1203] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 20 12:34:33 2022] GET /compute/v2.1/servers/36070a3e-9c08-45f3-a574-2412cabfe0ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 12:34:33.724888 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:33.725495 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:34:33.731577 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.732023 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.732780 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:34:33.733418 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:34:33.863649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:33.871640 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:33.873167 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:34:33.874566 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-2ca2ae24-68d7-4537-9b8e-4f07bdb73122 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1716 microversion: 2.20 time: 0.153965 Jun 20 12:34:33.875115 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 607/1204] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:34:33 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:34:35.219358 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-b31e9423-274e-4c95-9ced-684939d44ff7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] Calling method '.version_select at 0x7fe283f3eca0>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:34:35.312588 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-b31e9423-274e-4c95-9ced-684939d44ff7 tempest-TestVolumeBootPattern-1832776522 tempest-TestVolumeBootPattern-1832776522-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1645848315" status: 202 len: 0 microversion: 2.1 time: 0.097682 Jun 20 12:34:35.313169 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 598/1205] 10.222.0.64 () {58 vars in 1262 bytes} [Mon Jun 20 12:34:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1645848315 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 12:35:03.550899 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-d614a914-5102-4ec0-948b-de92de089562 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:03.552510 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-d614a914-5102-4ec0-948b-de92de089562 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:03.554733 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_api:SELECT=5 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:03.555473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG dbcounter [-] [118092] Writing DB stats nova_cell1:SELECT=81 {{(pid=118092) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:03.560321 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d614a914-5102-4ec0-948b-de92de089562 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:03.560845 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d614a914-5102-4ec0-948b-de92de089562 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:03.561709 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d614a914-5102-4ec0-948b-de92de089562 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:03.568472 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-d614a914-5102-4ec0-948b-de92de089562 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:03.592156 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-d614a914-5102-4ec0-948b-de92de089562 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045575 Jun 20 12:35:03.592718 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 608/1206] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 20 12:35:03 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 12:35:03.652894 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:03.653427 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:03.655675 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:03.656325 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG dbcounter [-] [118091] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:03.662352 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:03.662810 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:03.663588 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:03.664035 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:03.689904 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Going to try to terminate instance {{(pid=118091) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 12:35:03.977287 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-a74879f3-de26-4c68-a23c-82edd178b6dd tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 204 len: 0 microversion: 2.20 time: 0.327827 Jun 20 12:35:03.977980 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 599/1207] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 20 12:35:03 2022] DELETE /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 12:35:03.986807 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:03.987421 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:03.995357 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:03.995809 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:03.996564 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:03.996989 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:04.128962 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:04.137149 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:04.140794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.policy [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118092) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:04.140794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-61ed5fda-bf24-48d9-8f46-dab6c39f95fb tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.157487 Jun 20 12:35:04.140794 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 609/1208] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:35:03 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:35:05.159617 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:05.160317 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:05.167306 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:05.167760 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:05.168537 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:05.168978 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:05.359238 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:05.368343 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:05.369604 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:05.370802 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-e77fedc1-eb7d-45f8-914c-7606a17f423b tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1722 microversion: 2.20 time: 0.215698 Jun 20 12:35:05.371357 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 600/1209] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:35:05 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:35:06.284337 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [req-092db443-c38a-4031-983a-ed83bd783311 req-55097d25-df9f-4fff-8f76-c2226c8c0637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca", "name": "network-vif-deleted", "tag": "a153f1e2-8f1b-4917-87a9-323c0e6cba3c"}]} {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 12:35:06.293252 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-092db443-c38a-4031-983a-ed83bd783311 req-55097d25-df9f-4fff-8f76-c2226c8c0637 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:06.293705 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [req-092db443-c38a-4031-983a-ed83bd783311 req-55097d25-df9f-4fff-8f76-c2226c8c0637 service nova] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:06.305198 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.compute.server_external_events [req-092db443-c38a-4031-983a-ed83bd783311 req-55097d25-df9f-4fff-8f76-c2226c8c0637 service nova] Creating event network-vif-deleted:a153f1e2-8f1b-4917-87a9-323c0e6cba3c for instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca on hv-cinder-83697 Jun 20 12:35:06.310391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [req-092db443-c38a-4031-983a-ed83bd783311 req-55097d25-df9f-4fff-8f76-c2226c8c0637 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029667 Jun 20 12:35:06.311016 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 610/1210] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 20 12:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 12:35:06.389979 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:06.390737 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:06.398470 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:06.398924 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:06.399718 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:06.400274 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:06.469959 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:06.481180 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:06.484127 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.policy [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65f0d59c17874c949670e0e81c5b74f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882feee6f30d4e52b8ab28f7e7193568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118091) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 12:35:06.485960 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-42ecfe8a-5a66-4f76-a8b7-94395aabdae8 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 200 len: 1655 microversion: 2.20 time: 0.101217 Jun 20 12:35:06.499499 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 601/1211] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:35:06 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 1655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 12:35:07.508430 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:07.509113 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:07.515464 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:07.515901 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:07.516704 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:07.517133 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:07.530711 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] HTTP exception thrown: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Request method failure captured: Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca HTTP/1.1 Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGg4Z1sO0wWnwoRxZzhJ4p5k0M3A0rQyRcotNBSQAIWXcMoK_MolK5VcjQjhOGdmjCh15mGBdEGey1I1Ur4XnMJQiQvrXeunfUDgLnRsFBNASQl0lhcbnel6CsJV7lwHlPab0rttKmK2TRPrHU9O9dj13wq3ip8Ot3TW6LTo2f2ai5A Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:35:07.532291 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}] Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 65f0d59c17874c949670e0e81c5b74f4 Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:07.534083 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca'} Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:07.535060 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:07.537653 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:07.539091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Returning 404 to user: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:07.539091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-60c8acd2-8085-4be2-a81b-9714a2fcfe06 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 404 len: 111 microversion: 2.20 time: 0.030193 Jun 20 12:35:07.539091 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 611/1212] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:35:07 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:35:07.543393 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-61e0cbe8-731a-4b29-8361-60020d7a5034 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '.version_select at 0x7fe295269c10>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:07.616894 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-61e0cbe8-731a-4b29-8361-60020d7a5034 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408796740" status: 204 len: 0 microversion: 2.20 time: 0.077490 Jun 20 12:35:07.617498 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 602/1213] 10.222.0.64 () {60 vars in 1261 bytes} [Mon Jun 20 12:35:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408796740 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 12:35:09.652229 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:09.652723 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:09.659035 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:09.659473 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:09.660222 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:09.660649 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:09.675834 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] HTTP exception thrown: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Request method failure captured: Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca HTTP/1.1 Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGg4Z1sO0wWnwoRxZzhJ4p5k0M3A0rQyRcotNBSQAIWXcMoK_MolK5VcjQjhOGdmjCh15mGBdEGey1I1Ur4XnMJQiQvrXeunfUDgLnRsFBNASQl0lhcbnel6CsJV7lwHlPab0rttKmK2TRPrHU9O9dj13wq3ip8Ot3TW6LTo2f2ai5A Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:35:09.677361 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}] Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 65f0d59c17874c949670e0e81c5b74f4 Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.679260 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': '3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca'} Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:09.680053 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.681422 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.695414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Returning 404 to user: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:09.695414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-88a3a3ee-6288-44e4-8657-9a26455a1e6c tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 404 len: 111 microversion: 2.20 time: 0.031590 Jun 20 12:35:09.695414 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 612/1214] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 20 12:35:09 2022] DELETE /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:35:09.701216 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:09.701964 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:09.709056 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:09.710149 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:09.710923 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:09.711366 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:09.724272 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] HTTP exception thrown: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Request method failure captured: Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca HTTP/1.1 Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGg4Z1sO0wWnwoRxZzhJ4p5k0M3A0rQyRcotNBSQAIWXcMoK_MolK5VcjQjhOGdmjCh15mGBdEGey1I1Ur4XnMJQiQvrXeunfUDgLnRsFBNASQl0lhcbnel6CsJV7lwHlPab0rttKmK2TRPrHU9O9dj13wq3ip8Ot3TW6LTo2f2ai5A Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:35:09.726597 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}] Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 65f0d59c17874c949670e0e81c5b74f4 Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.736282 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': '3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca'} Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:09.737234 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. Jun 20 12:35:09.738841 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:09.740847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Returning 404 to user: Instance 3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:09.740847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-49dde18b-6d60-4434-a0fc-5f3c2e836a26 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca" status: 404 len: 111 microversion: 2.20 time: 0.030785 Jun 20 12:35:09.740847 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 603/1215] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:35:09 2022] GET /compute/v2.1/servers/3ce323b8-fb5d-4cdf-8306-88b9c4baf1ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:35:11.067095 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:11.067535 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.compute.api [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118092) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:11.074391 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.074831 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.075597 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.076029 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG oslo_concurrency.lockutils [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118092) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.091495 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.wsgi [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] HTTP exception thrown: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Request method failure captured: Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: request: DELETE /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 HTTP/1.1 Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept: application/json Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Accept-Encoding: identity Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Connection: close Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Length: 0 Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Content-Type: application/json Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Host: 10.222.0.64 Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Openstack-System-Scope: None Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Auth-Token: gAAAAABisGg4Z1sO0wWnwoRxZzhJ4p5k0M3A0rQyRcotNBSQAIWXcMoK_MolK5VcjQjhOGdmjCh15mGBdEGey1I1Ur4XnMJQiQvrXeunfUDgLnRsFBNASQl0lhcbnel6CsJV7lwHlPab0rttKmK2TRPrHU9O9dj13wq3ip8Ot3TW6LTo2f2ai5A Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Id: None Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Domain-Name: None Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Identity-Status: Confirmed Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Is-Admin-Project: True Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Id: default Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Domain-Name: Default Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Role: reader,member Jun 20 12:35:11.093148 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Roles: reader,member Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}] Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Id: default Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Domain-Name: Default Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Id: 65f0d59c17874c949670e0e81c5b74f4 Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: X-User-Name: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: method: > Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: exception: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.094996 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: action_args: {'id': 'f89bc6b5-c488-4237-b3ca-c18adfee49e0'} Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: {{(pid=118092) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:11.095928 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.097530 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.099533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: DEBUG nova.api.openstack.wsgi [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Returning 404 to user: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. {{(pid=118092) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:11.099533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO nova.api.openstack.requestlog [None req-b53625c9-8c2e-4511-ba5a-7899b93679b2 tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 404 len: 111 microversion: 2.20 time: 0.031641 Jun 20 12:35:11.099533 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: [pid: 118092|app: 0|req: 613/1216] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 20 12:35:11 2022] DELETE /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 12:35:11.104264 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Calling method '>' {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 12:35:11.104918 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.compute.api [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] [instance: f89bc6b5-c488-4237-b3ca-c18adfee49e0] Fetching instance by UUID {{(pid=118091) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 12:35:11.111583 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.114816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.114816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 12:35:11.114816 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG oslo_concurrency.lockutils [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Lock "1005ee0f-ec24-457d-9b36-b8a9b0504dd6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 12:35:11.129278 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.wsgi [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] HTTP exception thrown: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Request method failure captured: Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: request: GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 HTTP/1.1 Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept: application/json Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Accept-Encoding: identity Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Connection: close Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Length: 0 Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Content-Type: application/json Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Host: 10.222.0.64 Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Openstack-System-Scope: None Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: User-Agent: python-urllib3/1.26.9 Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Auth-Token: gAAAAABisGg4Z1sO0wWnwoRxZzhJ4p5k0M3A0rQyRcotNBSQAIWXcMoK_MolK5VcjQjhOGdmjCh15mGBdEGey1I1Ur4XnMJQiQvrXeunfUDgLnRsFBNASQl0lhcbnel6CsJV7lwHlPab0rttKmK2TRPrHU9O9dj13wq3ip8Ot3TW6LTo2f2ai5A Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Id: None Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Domain-Name: None Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Identity-Status: Confirmed Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Is-Admin-Project: True Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Id: default Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Domain-Name: Default Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Role: reader,member Jun 20 12:35:11.130849 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Roles: reader,member Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/882feee6f30d4e52b8ab28f7e7193568"}]}] Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Id: 882feee6f30d4e52b8ab28f7e7193568 Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-445080578 Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Id: default Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Domain-Name: Default Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Id: 65f0d59c17874c949670e0e81c5b74f4 Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: X-User-Name: tempest-AttachVolumeShelveTestJSON-445080578-project Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: method: > Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: exception: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.132631 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: action_args: {'id': 'f89bc6b5-c488-4237-b3ca-c18adfee49e0'} Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: {{(pid=118091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 12:35:11.133693 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. Jun 20 12:35:11.135503 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: ERROR nova.api.openstack.wsgi Jun 20 12:35:11.137029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: DEBUG nova.api.openstack.wsgi [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] Returning 404 to user: Instance f89bc6b5-c488-4237-b3ca-c18adfee49e0 could not be found. {{(pid=118091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 12:35:11.137029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO nova.api.openstack.requestlog [None req-c7798f3d-1f69-463e-930d-ca79932f00bc tempest-AttachVolumeShelveTestJSON-445080578 tempest-AttachVolumeShelveTestJSON-445080578-project] 10.222.0.64 "GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0" status: 404 len: 111 microversion: 2.20 time: 0.032748 Jun 20 12:35:11.137029 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: [pid: 118091|app: 0|req: 604/1217] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 20 12:35:11 2022] GET /compute/v2.1/servers/f89bc6b5-c488-4237-b3ca-c18adfee49e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 12:35:55.010224 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:35:55.010840 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Mon Jun 20 12:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:38:03.699247 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:38:03.699869 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Mon Jun 20 12:38:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:38:15.446378 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:38:15.447039 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Mon Jun 20 12:38:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:38:23.145756 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:38:23.146471 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Mon Jun 20 12:38:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:39:15.019687 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:39:15.020253 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Mon Jun 20 12:39:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:39:49.314696 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:39:49.315407 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Mon Jun 20 12:39:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:40:07.883846 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:40:07.884626 dv-cinder-836973-4-iscsi devstack@n-api.service[118092]: Mon Jun 20 12:40:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 12:41:23.707403 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 12:41:23.707993 dv-cinder-836973-4-iscsi devstack@n-api.service[118091]: Mon Jun 20 12:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!